Apr 17 16:14:13 devstack cinder-volume[72335]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 17 16:14:13 devstack cinder-volume[72335]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 16:14:13 devstack cinder-volume[72335]: we strongly recommend against using it for new projects. Apr 17 16:14:13 devstack cinder-volume[72335]: If you are already using Eventlet, we recommend migrating to a different Apr 17 16:14:13 devstack cinder-volume[72335]: framework. For more detail see Apr 17 16:14:13 devstack cinder-volume[72335]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 16:14:13 devstack cinder-volume[72335]: import eventlet # noqa Apr 17 16:14:14 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 16:14:14 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 16:14:14 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 16:14:15 devstack cinder-volume[72335]: INFO dbcounter [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Registered counter for database cinder Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG dbcounter [-] [72335] Writer thread running {{(pid=72335) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 16:14:15 devstack cinder-volume[72335]: INFO cinder.rpc [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 17 16:14:15 devstack cinder-volume[72335]: INFO cinder.rpc [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:14:15 devstack cinder-volume[72335]: INFO cinder.volume.manager [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Determined volume DB was empty at startup. Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG cinder.volume.manager [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72335) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 17 16:14:15 devstack cinder-volume[72335]: INFO cinder.volume.manager [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 17 16:14:15 devstack cinder-volume[72335]: WARNING stevedore.named [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 16:14:15 devstack cinder-volume[72335]: WARNING castellan.key_manager [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 16:14:15 devstack cinder-volume[72335]: WARNING cinder.keymgr.conf_key_mgr [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG cinder.volume.drivers.lvm [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72335) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_concurrency.processutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72335) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_concurrency.processutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.237s {{(pid=72335) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:14:15 devstack cinder-volume[72335]: INFO cinder.rpc [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 17 16:14:15 devstack cinder-volume[72335]: INFO cinder.rpc [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 17 16:14:15 devstack cinder-volume[72335]: WARNING stevedore.named [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 16:14:15 devstack cinder-volume[72335]: WARNING castellan.key_manager [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 16:14:15 devstack cinder-volume[72335]: INFO cinder.volume.manager [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:14:15 devstack cinder-volume[72335]: INFO oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Starting 1 workers Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Started child 72439 {{(pid=72335) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Full set of CONF: {{(pid=72335) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] ******************************************************************************** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Configuration options gathered from: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] ================================================================================ {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] allow_availability_zone_fallback = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] allow_compression_on_image_upload = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] allowed_direct_url_schemes = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] api_rate_limit = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72439]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] auth_strategy = keystone {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] az_cache_duration = 3600 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_host = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_stats_polling_interval = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backup_api_class = cinder.backup.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backup_name_template = backup-%s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backup_use_same_host = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backup_use_temp_snapshot = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] chap_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] chap_username = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_internal_tenant_project_id = 98f2aec924454f18acad75264d2fb73c {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_internal_tenant_user_id = 81365491a0a14e4e952c1ec1d0b2bb9f {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cloned_volume_same_az = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cluster = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] compression_format = gzip {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] compute_api_class = cinder.compute.nova.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] config_dir = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] config_source = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] control_exchange = openstack {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] debug = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] default_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] default_group_type = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] default_volume_type = lvmdriver-1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] disk_geometry = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] driver_client_cert = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] driver_client_cert_key = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] driver_data_namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] driver_ssl_cert_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] driver_ssl_cert_verify = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] driver_use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] enable_force_upload = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] enable_new_services = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] enable_unsupported_driver = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] enforce_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] filter_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_api_insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_api_ssl_compression = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_ca_certificates_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_catalog_info = image:glance:publicURL {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_num_retries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance_request_timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] goodness_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] graceful_shutdown_timeout = 5 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] group_api_class = cinder.group.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] host = devstack {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_compress_on_upload = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_conversion_address_space_limit = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_conversion_cpu_limit = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_conversion_disable = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_upload_use_cinder_backend = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_upload_use_internal_tenant = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_volume_cache_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_volume_cache_max_count = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] image_volume_cache_max_size_gb = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] init_host_max_objects_retrieval = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] instance_format = [instance: %(uuid)s] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] iscsi_target_flags = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] iscsi_write_cache = on {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] iser_helper = tgtadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] iser_ip_address = 192.168.122.132 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] iser_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_color = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_config_append = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_dir = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_options = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_rotate_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_rotate_interval_type = days {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] log_rotation_type = none {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] max_age = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] max_logfile_count = 30 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] max_logfile_size_mb = 200 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] max_over_subscription_ratio = 20.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] message_reap_interval = 86400 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] message_ttl = 2592000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] migration_create_volume_timeout_secs = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] monkey_patch = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] monkey_patch_modules = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] my_ip = 192.168.122.132 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] no_snapshot_gb_quota = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] num_iser_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] num_shell_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] num_volume_device_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] nvmeof_conn_info_version = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] nvmet_ns_id = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] nvmet_port_id = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] osapi_max_limit = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] osapi_volume_ext_list = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] osapi_volume_listen_port = 8776 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] osapi_volume_use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] osapi_volume_workers = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] per_volume_size_limit = -1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] periodic_fuzzy_delay = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] periodic_interval = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] public_endpoint = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] publish_errors = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] quota_backup_gigabytes = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] quota_backups = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] quota_gigabytes = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] quota_groups = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] quota_snapshots = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] quota_volumes = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] rate_limit_burst = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] rate_limit_except_level = CRITICAL {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] rate_limit_interval = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] reinit_driver_count = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72439]: INFO cinder.volume.manager [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 17 16:14:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] replication_device = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] report_discard_supported = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] report_interval = 120 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] reservation_clean_interval = 86400 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] reservation_expire = 86400 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] reserved_image_namespaces = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] reserved_percentage = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] rpc_response_timeout = 120 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] run_external_periodic_tasks = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] scst_target_driver = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] scst_target_iqn_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_down_time = 720 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] shell_completion = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] snapshot_name_template = snapshot-%s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] snapshot_same_host = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] state_path = /opt/stack/data/cinder {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] storage_availability_zone = nova {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] storage_protocol = iSCSI {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] syslog_log_facility = LOG_USER {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] target_helper = lioadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] target_ip_address = 192.168.122.132 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] target_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] target_protocol = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] target_secondary_ip_addresses = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] trace_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] transport_url = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] until_refresh = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] use_chap_auth = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] use_default_quota_class = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] use_journal = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] use_json = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] use_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] use_stderr = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] use_syslog = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] verify_glance_signatures = enabled {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_api_class = cinder.volume.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_backend_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_clear = zero {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_clear_ionice = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_clear_size = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_copy_bps_limit = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_dd_blocksize = 1M {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_name_template = volume-%s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_service_inithost_offload = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volume_usage_audit_period = month {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] zoning_mode = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.admin_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.admin_token = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.admin_user = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_port = 35357 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_protocol = https {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_type = password {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_uri = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.auth_version = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.cache = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.identity_uri = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.include_service_catalog = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.interface = public {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_password = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcache_username = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.region_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.service_type = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.backend = dogpile.cache.null {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.backend_argument = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.backend_expiration_time = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.config_prefix = cache.oslo {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.debug_cache_backend = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.enable_retry_client = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.enable_socket_keepalive = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.enforce_fips_mode = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.expiration_time = 600 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.memcache_dead_retry = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.memcache_pool_maxsize = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.memcache_sasl_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.proxies = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.redis_db = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.redis_server = localhost:6379 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.retry_attempts = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.retry_delay = 0.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.socket_keepalive_count = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.socket_keepalive_idle = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.socket_keepalive_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.socket_timeout = 1.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.tls_allowed_ciphers = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.tls_cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.tls_certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.tls_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.tls_keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cache.username = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] coordination.backend_url = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.asyncio_connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.asyncio_slave_connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.backend = sqlalchemy {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.connection_debug = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.connection_parameters = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.connection_recycle_time = 3600 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.connection_trace = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.db_inc_retry_interval = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.db_max_retries = 20 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.db_max_retry_interval = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.db_retry_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.max_overflow = 50 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.max_pool_size = 5 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.max_retries = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.pool_timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.retry_interval = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.slave_connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.sqlite_synchronous = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.synchronous_reader = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] database.use_db_reconnect = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.connection_string = messaging:// {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.es_doc_type = notification {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.es_scroll_size = 10000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.es_scroll_time = 2m {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.filter_error_trace = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.hmac_keys = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.sentinel_service_name = mymaster {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.socket_timeout = 0.1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.trace_requests = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler.trace_sqlalchemy = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler_jaeger.process_tags = {} {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] profiler_otlp.service_name_prefix = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.enforce_new_defaults = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: WARNING oslo_config.cfg [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.enforce_scope = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.policy_default_rule = default {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.policy_file = policy.yaml {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] privsep_osbrick.group = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] privsep_osbrick.helper_command = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] privsep_osbrick.user = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_sys_admin.group = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_sys_admin.helper_command = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] cinder_sys_admin.user = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.auth_type = password {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.send_service_user_token = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] service_user.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.auth_type = password {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.region_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] glance.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.backend_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.chap_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.chap_username = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.disk_geometry = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.driver_client_cert = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.driver_client_cert_key = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.driver_data_namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.driver_use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.extra_capabilities = {} {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.filter_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.goodness_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.iscsi_target_flags = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.iscsi_write_cache = on {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:15 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.iser_helper = tgtadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.074s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:16 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.iser_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.lvm_share_target = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.lvm_type = auto {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.num_shell_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.replication_device = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.report_discard_supported = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.reserved_percentage = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.target_helper = tgtadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.target_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.target_protocol = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.trace_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.unique_fqdn_network = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.use_chap_auth = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_backend_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_clear = zero {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_clear_ionice = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_clear_size = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_reports.file_event_handler = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_reports.log_dir = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.backend_host = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.chap_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.chap_username = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.disk_geometry = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.driver_client_cert = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.extra_capabilities = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.filter_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.goodness_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.iser_helper = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.iser_ip_address = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.iser_port = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.lvm_share_target = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.lvm_type = auto {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.num_shell_tries = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.replication_device = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.report_discard_supported = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.reserved_percentage = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.scst_target_driver = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.storage_protocol = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack sudo[72443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.target_helper = lioadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.target_ip_address = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack sudo[72443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.target_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.trace_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.use_chap_auth = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_clear = zero {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_clear_size = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] lvmdriver-1.volumes_dir = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_notifications.driver = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] key_manager.fixed_key = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.barbican_api_version = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.barbican_endpoint = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.barbican_endpoint_type = public {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.barbican_region_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.number_of_retries = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.retry_delay = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.send_service_user_token = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.verify_ssl = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican.verify_ssl_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.auth_type = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] barbican_service_user.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.approle_role_id = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.approle_secret_id = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.kv_mountpoint = secret {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.kv_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.kv_version = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.root_token_id = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.ssl_ca_crt_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.timeout = 60.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:14:16 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] ******************************************************************************** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 17 16:14:16 devstack sudo[72443]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:16 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:16 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:16 devstack sudo[72454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:16 devstack sudo[72454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:17 devstack sudo[72454]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.500s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:14:17 devstack cinder-volume[72439]: INFO cinder.brick.local_dev.lvm [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:17 devstack sudo[72696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:14:17 devstack sudo[72696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:17 devstack sudo[72696]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG cinder.brick.local_dev.lvm [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72439) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 17 16:14:17 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:17 devstack sudo[72914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:17 devstack sudo[72914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:18 devstack sudo[72914]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.752s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:18 devstack sudo[73044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:18 devstack sudo[73044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:18 devstack sudo[73044]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:18 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:18 devstack sudo[73131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 17 16:14:18 devstack sudo[73131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:19 devstack sudo[73131]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:19 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.461s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:19 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:19 devstack sudo[73139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:14:19 devstack sudo[73139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:19 devstack sudo[73139]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:19 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:19 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:19 devstack sudo[73142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:14:19 devstack sudo[73142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:20 devstack sudo[73142]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:20 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:20 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:20 devstack sudo[73150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:14:20 devstack sudo[73150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:20 devstack sudo[73150]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:20 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:20 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:20 devstack sudo[73156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:20 devstack sudo[73156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:21 devstack sudo[73156]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:21 devstack sudo[73163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:21 devstack sudo[73163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:21 devstack sudo[73163]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:21 devstack cinder-volume[72439]: INFO cinder.volume.drivers.lvm [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:21 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:21 devstack sudo[73167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:21 devstack sudo[73167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:22 devstack sudo[73167]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:22 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:22 devstack cinder-volume[72439]: DEBUG cinder.volume.drivers.lvm [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Updating volume stats {{(pid=72439) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 16:14:22 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:22 devstack sudo[73207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:14:22 devstack sudo[73207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:22 devstack sudo[73207]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:22 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:22 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:22 devstack sudo[73292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:14:22 devstack sudo[73292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:23 devstack sudo[73292]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:23 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:23 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:23 devstack sudo[73430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:23 devstack sudo[73430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:23 devstack sudo[73430]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:23 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:23 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:23 devstack sudo[73433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:14:23 devstack sudo[73433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:24 devstack sudo[73433]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:24 devstack cinder-volume[72439]: INFO cinder.volume.driver [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Driver hasn't implemented _init_vendor_properties() Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG cinder.volume.driver [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72439) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG oslo_db.sqlalchemy.engines [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG dbcounter [-] [72439] Writer thread running {{(pid=72439) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG cinder.db.sqlalchemy.api [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Building query based on filter {{(pid=72439) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG cinder.image.image_utils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72439) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 17 16:14:24 devstack cinder-volume[72439]: INFO cinder.keymgr.migration [None req-1a058f68-6885-4301-b011-2cd47acb8cd3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG cinder.volume.drivers.lvm [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Updating volume stats {{(pid=72439) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:24 devstack sudo[73438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:14:24 devstack sudo[73438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:24 devstack sudo[73438]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:24 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:24 devstack sudo[73444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:14:24 devstack sudo[73444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:25 devstack sudo[73444]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:25 devstack sudo[73447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:25 devstack sudo[73447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:25 devstack sudo[73447]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:25 devstack sudo[73451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:14:25 devstack sudo[73451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:25 devstack cinder-volume[72335]: DEBUG dbcounter [-] [72335] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72335) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:14:25 devstack sudo[73451]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG cinder.manager [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Notifying Schedulers of capabilities ... {{(pid=72439) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:14:25 devstack cinder-volume[72439]: INFO cinder.volume.manager [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Driver initialization completed successfully. Apr 17 16:14:25 devstack cinder-volume[72439]: INFO cinder.manager [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Initiating service 2 cleanup Apr 17 16:14:25 devstack cinder-volume[72439]: INFO cinder.manager [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Service 2 cleanup completed. Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG cinder.service [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Creating RPC server for service cinder-volume {{(pid=72439) start /opt/stack/cinder/cinder/service.py:231}} Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG cinder.service [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72439) start /opt/stack/cinder/cinder/service.py:237}} Apr 17 16:14:25 devstack cinder-volume[72439]: INFO cinder.volume.manager [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG cinder.volume.drivers.lvm [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Updating volume stats {{(pid=72439) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 16:14:25 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:26 devstack sudo[73456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:14:26 devstack sudo[73456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:26 devstack sudo[73456]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:26 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:26 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:26 devstack sudo[73464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:14:26 devstack sudo[73464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:26 devstack sudo[73464]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:26 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:26 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:26 devstack sudo[73467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:14:26 devstack sudo[73467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:27 devstack sudo[73467]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:27 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:27 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:14:27 devstack sudo[73524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:14:27 devstack sudo[73524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:14:27 devstack sudo[73524]: pam_unix(sudo:session): session closed for user root Apr 17 16:14:27 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:14:27 devstack cinder-volume[72439]: INFO cinder.volume.manager [None req-75d2d8d3-8051-4723-91e5-8f8c161154f7 None None] Driver post RPC initialization completed successfully. Apr 17 16:14:35 devstack cinder-volume[72439]: DEBUG dbcounter [-] [72439] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72439) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:14:37 devstack cinder-volume[72439]: DEBUG dbcounter [-] [72439] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72439) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:15:47 devstack cinder-volume[72439]: DEBUG oslo_service.periodic_task [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72439) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:15:47 devstack cinder-volume[72439]: DEBUG cinder.volume.drivers.lvm [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Updating volume stats {{(pid=72439) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 16:15:47 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:15:47 devstack sudo[78389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:15:47 devstack sudo[78389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:15:48 devstack sudo[78389]: pam_unix(sudo:session): session closed for user root Apr 17 16:15:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:15:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:15:48 devstack sudo[78397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:15:48 devstack sudo[78397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:15:48 devstack sudo[78397]: pam_unix(sudo:session): session closed for user root Apr 17 16:15:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:15:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:15:48 devstack sudo[78408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:15:48 devstack sudo[78408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:15:49 devstack sudo[78408]: pam_unix(sudo:session): session closed for user root Apr 17 16:15:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:15:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:15:49 devstack sudo[78416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:15:49 devstack sudo[78416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:15:49 devstack sudo[78416]: pam_unix(sudo:session): session closed for user root Apr 17 16:15:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:15:49 devstack cinder-volume[72439]: DEBUG cinder.manager [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Notifying Schedulers of capabilities ... {{(pid=72439) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:16:37 devstack cinder-volume[72439]: DEBUG dbcounter [-] [72439] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72439) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:16:47 devstack cinder-volume[72439]: DEBUG oslo_service.periodic_task [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72439) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:16:47 devstack cinder-volume[72439]: DEBUG cinder.volume.drivers.lvm [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Updating volume stats {{(pid=72439) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 16:16:47 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:16:47 devstack sudo[80295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:16:47 devstack sudo[80295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:16:48 devstack sudo[80295]: pam_unix(sudo:session): session closed for user root Apr 17 16:16:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:16:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:16:48 devstack sudo[80299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:16:48 devstack sudo[80299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:16:48 devstack sudo[80299]: pam_unix(sudo:session): session closed for user root Apr 17 16:16:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:16:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:16:48 devstack sudo[80303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:16:48 devstack sudo[80303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:16:49 devstack sudo[80303]: pam_unix(sudo:session): session closed for user root Apr 17 16:16:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:16:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:16:49 devstack sudo[80317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:16:49 devstack sudo[80317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:16:49 devstack sudo[80317]: pam_unix(sudo:session): session closed for user root Apr 17 16:16:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:16:49 devstack cinder-volume[72439]: DEBUG cinder.manager [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Notifying Schedulers of capabilities ... {{(pid=72439) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:17:46 devstack cinder-volume[72335]: INFO oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Caught SIGTERM, stopping children Apr 17 16:17:46 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Acquiring lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 16:17:46 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Acquired lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 16:17:46 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Releasing lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 16:17:46 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Stop services. {{(pid=72335) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 17 16:17:46 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Killing children. {{(pid=72335) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 17 16:17:46 devstack cinder-volume[72335]: INFO oslo_service.backend._eventlet.service [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Waiting on 1 children to exit Apr 17 16:17:47 devstack cinder-volume[72439]: DEBUG oslo_service.periodic_task [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72439) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:17:47 devstack cinder-volume[72439]: DEBUG cinder.volume.drivers.lvm [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Updating volume stats {{(pid=72439) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 16:17:47 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:47 devstack sudo[81497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 16:17:47 devstack sudo[81497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:48 devstack sudo[81497]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:48 devstack sudo[81500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:17:48 devstack sudo[81500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:48 devstack sudo[81500]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:48 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:48 devstack sudo[81503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 16:17:48 devstack sudo[81503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:49 devstack sudo[81503]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:49 devstack sudo[81506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 16:17:49 devstack sudo[81506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:49 devstack sudo[81506]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:49 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:49 devstack cinder-volume[72439]: DEBUG cinder.manager [None req-0be8788f-df31-42fa-84ee-51980660a2fd None None] Notifying Schedulers of capabilities ... {{(pid=72439) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:17:50 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Acquiring lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 16:17:50 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Acquired lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 16:17:50 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Releasing lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 16:17:50 devstack cinder-volume[72439]: WARNING amqp [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 16:17:51 devstack cinder-volume[72439]: WARNING amqp [None req-93eae349-8c30-4725-848c-5564d17840c6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 16:17:51 devstack cinder-volume[81511]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 17 16:17:51 devstack cinder-volume[81511]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 16:17:51 devstack cinder-volume[81511]: we strongly recommend against using it for new projects. Apr 17 16:17:51 devstack cinder-volume[81511]: If you are already using Eventlet, we recommend migrating to a different Apr 17 16:17:51 devstack cinder-volume[81511]: framework. For more detail see Apr 17 16:17:51 devstack cinder-volume[81511]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 16:17:51 devstack cinder-volume[81511]: import eventlet # noqa Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 16:17:53 devstack cinder-volume[81511]: INFO dbcounter [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Registered counter for database cinder Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_db.sqlalchemy.engines [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81511) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG dbcounter [-] [81511] Writer thread running {{(pid=81511) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 16:17:53 devstack cinder-volume[81511]: INFO cinder.rpc [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 17 16:17:53 devstack cinder-volume[81511]: INFO cinder.rpc [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_db.sqlalchemy.engines [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81511) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:17:53 devstack cinder-volume[81511]: INFO cinder.volume.manager [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Determined volume DB was empty at startup. Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG cinder.volume.manager [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81511) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 17 16:17:53 devstack cinder-volume[81511]: INFO cinder.volume.manager [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 17 16:17:53 devstack cinder-volume[81511]: WARNING stevedore.named [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 16:17:53 devstack cinder-volume[81511]: WARNING castellan.key_manager [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 16:17:53 devstack cinder-volume[81511]: WARNING cinder.keymgr.conf_key_mgr [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 16:17:53 devstack cinder-volume[81511]: INFO cinder.volume.manager [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_db.sqlalchemy.engines [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81511) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:17:53 devstack cinder-volume[81511]: INFO oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Starting 1 workers Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Started child 81627 {{(pid=81511) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Full set of CONF: {{(pid=81511) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] ******************************************************************************** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Configuration options gathered from: {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] ================================================================================ {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] allow_availability_zone_fallback = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] allow_compression_on_image_upload = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] allowed_direct_url_schemes = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] api_rate_limit = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] auth_strategy = keystone {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_availability_zone = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_host = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_stats_polling_interval = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backup_api_class = cinder.backup.api.API {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backup_name_template = backup-%s {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backup_use_same_host = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backup_use_temp_snapshot = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] chap_password = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] chap_username = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_internal_tenant_project_id = 98f2aec924454f18acad75264d2fb73c {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_internal_tenant_user_id = 81365491a0a14e4e952c1ec1d0b2bb9f {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cluster = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] compression_format = gzip {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] compute_api_class = cinder.compute.nova.API {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] config_dir = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] config_source = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] control_exchange = openstack {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81627]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] debug = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] default_availability_zone = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] default_group_type = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] default_volume_type = QuobyteHD {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] disk_geometry = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] driver_client_cert = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] driver_client_cert_key = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] driver_data_namespace = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] driver_ssl_cert_path = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] driver_ssl_cert_verify = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] driver_use_ssl = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] enable_new_services = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] enable_unsupported_driver = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] enabled_backends = ['QuobyteHD'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] enforce_multipath_for_image_xfer = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] filter_function = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_api_insecure = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_api_ssl_compression = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_ca_certificates_file = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_catalog_info = image:glance:publicURL {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_num_retries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance_request_timeout = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] goodness_function = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] graceful_shutdown_timeout = 5 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] group_api_class = cinder.group.api.API {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] host = devstack {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_compress_on_upload = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_conversion_address_space_limit = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_conversion_cpu_limit = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_conversion_disable = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_upload_use_cinder_backend = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_upload_use_internal_tenant = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_volume_cache_enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_volume_cache_max_count = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] image_volume_cache_max_size_gb = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] init_host_max_objects_retrieval = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:53 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] instance_format = [instance: %(uuid)s] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81627]: INFO cinder.volume.manager [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Starting volume driver QuobyteDriver (1.1.14) Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.remotefs [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81627) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] iscsi_target_flags = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] iscsi_write_cache = on {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] iser_helper = tgtadm {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] iser_ip_address = 192.168.122.132 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] iser_port = 3260 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_color = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_config_append = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_dir = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_file = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_options = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_rotate_interval = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_rotate_interval_type = days {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] log_rotation_type = none {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] max_age = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] max_logfile_count = 30 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] max_logfile_size_mb = 200 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] max_over_subscription_ratio = 20.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] message_reap_interval = 86400 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] message_ttl = 2592000 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] migration_create_volume_timeout_secs = 300 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] monkey_patch = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] monkey_patch_modules = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] my_ip = 192.168.122.132 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] no_snapshot_gb_quota = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] num_iser_scan_tries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] num_shell_tries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] num_volume_device_scan_tries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] nvmeof_conn_info_version = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] nvmet_ns_id = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] nvmet_port_id = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] osapi_max_limit = 1000 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] osapi_volume_ext_list = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] osapi_volume_listen = 0.0.0.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] osapi_volume_listen_port = 8776 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] osapi_volume_use_ssl = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] osapi_volume_workers = 2 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] per_volume_size_limit = -1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] periodic_fuzzy_delay = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] periodic_interval = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] project_id_regex = [0-9a-f\-]+ {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] public_endpoint = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] publish_errors = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] quota_backup_gigabytes = 1000 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] quota_backups = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] quota_gigabytes = 1000 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] quota_groups = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] quota_snapshots = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] quota_volumes = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] rate_limit_burst = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] rate_limit_except_level = CRITICAL {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] rate_limit_interval = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] reinit_driver_count = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] replication_device = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] report_discard_supported = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] report_interval = 120 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] reservation_clean_interval = 86400 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] reservation_expire = 86400 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] reserved_image_namespaces = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] reserved_percentage = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] rpc_response_timeout = 120 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] run_external_periodic_tasks = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] scst_target_driver = iscsi {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] scst_target_iqn_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_down_time = 720 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] shell_completion = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] snapshot_name_template = snapshot-%s {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] split_loggers = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] state_path = /opt/stack/data/cinder {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] storage_availability_zone = nova {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] storage_protocol = iSCSI {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] syslog_log_facility = LOG_USER {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] target_helper = lioadm {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] target_ip_address = 192.168.122.132 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] target_port = 3260 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] target_protocol = iscsi {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] target_secondary_ip_addresses = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] trace_flags = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] transfer_api_class = cinder.transfer.api.API {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] transport_url = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] until_refresh = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] use_chap_auth = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] use_default_quota_class = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] use_journal = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] use_json = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] use_multipath_for_image_xfer = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81627) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 17 16:17:54 devstack cinder-volume[81627]: WARNING cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 17 16:17:54 devstack cinder-volume[81627]: WARNING cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Running cmd (subprocess): mount.quobyte {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] use_stderr = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] use_syslog = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] verify_glance_signatures = enabled {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_api_class = cinder.volume.api.API {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_backend_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_clear = zero {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_clear_ionice = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_clear_size = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_copy_bps_limit = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_dd_blocksize = 1M {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_name_template = volume-%s {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_service_inithost_offload = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volume_usage_audit_period = month {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] zoning_mode = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_concurrency.disable_process_locking = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.admin_password = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.admin_token = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.admin_user = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_admin_prefix = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_port = 35357 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_protocol = https {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_section = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_type = password {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_uri = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.auth_version = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.cache = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.delay_auth_decision = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.http_connect_timeout = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.identity_uri = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.include_service_catalog = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.insecure = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.interface = public {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_password = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcache_username = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.region_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.service_token_roles_required = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.service_type = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.token_cache_time = 300 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.backend = dogpile.cache.null {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.backend_argument = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.backend_expiration_time = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.config_prefix = cache.oslo {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.debug_cache_backend = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.enable_retry_client = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.enable_socket_keepalive = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.enforce_fips_mode = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.expiration_time = 600 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.hashclient_retry_attempts = 2 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.memcache_dead_retry = 300 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.memcache_pool_maxsize = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.memcache_sasl_enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.password = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.proxies = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.redis_db = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.redis_sentinel_service_name = mymaster {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.redis_server = localhost:6379 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.retry_attempts = 2 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.retry_delay = 0.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.socket_keepalive_count = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.socket_keepalive_idle = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.socket_keepalive_interval = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.socket_timeout = 1.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.tls_allowed_ciphers = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.tls_cafile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.tls_certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.tls_enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.tls_keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cache.username = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] coordination.backend_url = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.asyncio_connection = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.asyncio_slave_connection = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.backend = sqlalchemy {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.connection = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.connection_debug = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.connection_parameters = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.connection_recycle_time = 3600 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.connection_trace = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.db_inc_retry_interval = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.db_max_retries = 20 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.db_max_retry_interval = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.db_retry_interval = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.max_overflow = 50 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.max_pool_size = 5 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.max_retries = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.mysql_wsrep_sync_wait = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.pool_timeout = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.retry_interval = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.slave_connection = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.sqlite_synchronous = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.synchronous_reader = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] database.use_db_reconnect = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.connection_string = messaging:// {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.es_doc_type = notification {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.es_scroll_size = 10000 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.es_scroll_time = 2m {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.filter_error_trace = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.hmac_keys = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.sentinel_service_name = mymaster {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.socket_timeout = 0.1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.trace_requests = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler.trace_sqlalchemy = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler_jaeger.process_tags = {} {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler_jaeger.service_name_prefix = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] profiler_otlp.service_name_prefix = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.enforce_new_defaults = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: WARNING oslo_config.cfg [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.enforce_scope = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.policy_default_rule = default {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.policy_file = policy.yaml {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack quobyte-client[81628]: Reading configuration file: /etc/quobyte/client.cfg Apr 17 16:17:54 devstack quobyte-client[81628]: Invalid parameters found, error: missing mount point. Apr 17 16:17:54 devstack quobyte-client[81628]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 17 16:17:54 devstack quobyte-client[81628]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_policy.remote_timeout = 60.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] privsep_osbrick.group = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] privsep_osbrick.helper_command = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] privsep_osbrick.user = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_sys_admin.group = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_sys_admin.helper_command = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] cinder_sys_admin.user = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] CMD "mount.quobyte" returned: 1 in 0.103s {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=81627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:17:54 devstack cinder-volume[81627]: INFO cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 ... Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 -c /etc/quobyte/client-cinder.cfg {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.auth_section = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.auth_type = password {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.cafile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.collect_timing = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.insecure = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.send_service_user_token = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.split_loggers = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] service_user.timeout = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.auth_section = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.auth_type = password {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.collect_timing = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.insecure = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.region_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.split_loggers = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] glance.timeout = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.backend_availability_zone = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.chap_password = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.chap_username = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.disk_geometry = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.driver_client_cert = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.driver_client_cert_key = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.driver_data_namespace = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.driver_use_ssl = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.enable_unsupported_driver = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.extra_capabilities = {} {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.filter_function = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.goodness_function = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.iscsi_target_flags = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.iscsi_write_cache = on {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.iser_helper = tgtadm {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.iser_port = 3260 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_host = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_login = admin {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_mount_options = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_password = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack sudo[81632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 -c /etc/quobyte/client-cinder.cfg Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_private_key = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack sudo[81632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_share_path = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_ssh_port = 22 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.num_shell_tries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.nvmet_port_id = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.quobyte_client_cfg = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.quobyte_volume_url = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.replication_device = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.report_discard_supported = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.reserved_percentage = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.scst_target_driver = iscsi {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.scst_target_iqn_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.storage_protocol = iSCSI {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.target_helper = tgtadm {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.target_port = 3260 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.target_protocol = iscsi {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.trace_flags = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.unique_fqdn_network = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.use_chap_auth = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_backend_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_clear = zero {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_clear_ionice = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_clear_size = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_reports.file_event_handler = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_reports.log_dir = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.backend_availability_zone = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.backend_host = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.chap_password = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.chap_username = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.chiscsi_conf = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.disk_geometry = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.driver_client_cert = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.driver_client_cert_key = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.driver_data_namespace = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.driver_use_ssl = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.extra_capabilities = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.filter_function = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.goodness_function = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.iscsi_target_flags = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.iscsi_write_cache = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.iser_helper = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.iser_ip_address = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.iser_port = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.iser_target_prefix = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_host = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_login = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_mount_options = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_password = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_private_key = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_share_path = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_ssh_port = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.num_shell_tries = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nvmet_ns_id = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.nvmet_port_id = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.replication_device = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.report_discard_supported = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.reserved_percentage = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.scst_target_driver = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.storage_protocol = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.target_helper = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.target_ip_address = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.target_port = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.target_prefix = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.target_protocol = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.trace_flags = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.unique_fqdn_network = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.use_chap_auth = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_clear = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_clear_ionice = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_clear_size = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] QuobyteHD.volumes_dir = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.ssl = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.ssl_version = {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_notifications.driver = [] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_notifications.retry = -1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] oslo_messaging_notifications.transport_url = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] key_manager.fixed_key = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.barbican_api_version = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.barbican_endpoint = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.barbican_endpoint_type = public {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.barbican_region_name = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.cafile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.collect_timing = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.insecure = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.number_of_retries = 60 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.retry_delay = 1 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.send_service_user_token = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.split_loggers = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.timeout = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.verify_ssl = True {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican.verify_ssl_path = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.auth_section = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.auth_type = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.cafile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.certfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.collect_timing = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.insecure = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.keyfile = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.split_loggers = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] barbican_service_user.timeout = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.approle_role_id = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.approle_secret_id = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.kv_mountpoint = secret {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.kv_path = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.kv_version = 2 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.namespace = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.root_token_id = **** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.ssl_ca_crt_file = None {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.timeout = 60.0 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.use_ssl = False {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:17:54 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] ******************************************************************************** {{(pid=81511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 17 16:17:54 devstack sudo[81632]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.518s {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:54 devstack cinder-volume[81627]: INFO cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 succeeded Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=81627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.524s {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:17:54 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:54 devstack sudo[81701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:17:54 devstack sudo[81701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:55 devstack sudo[81701]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.397s {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:55 devstack cinder-volume[81627]: INFO cinder.volume.driver [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Driver hasn't implemented _init_vendor_properties() Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.volume.driver [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81627) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_db.sqlalchemy.engines [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG dbcounter [-] [81627] Writer thread running {{(pid=81627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.db.sqlalchemy.api [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Building query based on filter {{(pid=81627) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.image.image_utils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81627) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 17 16:17:55 devstack cinder-volume[81627]: INFO cinder.keymgr.migration [None req-3d9990e3-f6d7-42fd-8097-5506adc872df None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=81627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=81627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:55 devstack sudo[81704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:17:55 devstack sudo[81704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:55 devstack sudo[81704]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.411s {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.manager [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Notifying Schedulers of capabilities ... {{(pid=81627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:17:55 devstack cinder-volume[81627]: INFO cinder.volume.manager [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Driver initialization completed successfully. Apr 17 16:17:55 devstack cinder-volume[81627]: INFO cinder.manager [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Initiating service 3 cleanup Apr 17 16:17:55 devstack cinder-volume[81627]: INFO cinder.manager [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Service 3 cleanup completed. Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.service [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Creating RPC server for service cinder-volume {{(pid=81627) start /opt/stack/cinder/cinder/service.py:231}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.service [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81627) start /opt/stack/cinder/cinder/service.py:237}} Apr 17 16:17:55 devstack cinder-volume[81627]: INFO cinder.volume.manager [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=81627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG cinder.volume.drivers.quobyte [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=81627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:17:55 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:17:55 devstack sudo[81741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:17:55 devstack sudo[81741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:17:56 devstack sudo[81741]: pam_unix(sudo:session): session closed for user root Apr 17 16:17:56 devstack cinder-volume[81627]: DEBUG oslo_concurrency.processutils [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.558s {{(pid=81627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:17:56 devstack cinder-volume[81627]: INFO cinder.volume.manager [None req-350c0259-8793-46ec-b691-c305c0933b6c None None] Driver post RPC initialization completed successfully. Apr 17 16:17:58 devstack cinder-volume[81511]: INFO oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Caught SIGTERM, stopping children Apr 17 16:17:58 devstack cinder-volume[81511]: DEBUG oslo_concurrency.lockutils [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Acquiring lock "singleton_lock" {{(pid=81511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 16:17:58 devstack cinder-volume[81511]: DEBUG oslo_concurrency.lockutils [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Acquired lock "singleton_lock" {{(pid=81511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 16:17:58 devstack cinder-volume[81511]: DEBUG oslo_concurrency.lockutils [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Releasing lock "singleton_lock" {{(pid=81511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 16:17:58 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Stop services. {{(pid=81511) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 17 16:17:58 devstack cinder-volume[81511]: DEBUG oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Killing children. {{(pid=81511) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 17 16:17:58 devstack cinder-volume[81511]: INFO oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Waiting on 1 children to exit Apr 17 16:18:00 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Acquiring lock "singleton_lock" {{(pid=81627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 16:18:00 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Acquired lock "singleton_lock" {{(pid=81627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 16:18:00 devstack cinder-volume[81627]: DEBUG oslo_concurrency.lockutils [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Releasing lock "singleton_lock" {{(pid=81627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 16:18:00 devstack cinder-volume[81627]: WARNING amqp [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 16:18:00 devstack cinder-volume[81627]: WARNING amqp [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 16:18:00 devstack cinder-volume[81511]: INFO oslo_service.backend._eventlet.service [None req-18b3afd7-937f-49cc-9c26-0112640de39c None None] Child 81627 exited with status 0 Apr 17 16:18:00 devstack cinder-volume[81881]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 17 16:18:00 devstack cinder-volume[81881]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 16:18:00 devstack cinder-volume[81881]: we strongly recommend against using it for new projects. Apr 17 16:18:00 devstack cinder-volume[81881]: If you are already using Eventlet, we recommend migrating to a different Apr 17 16:18:00 devstack cinder-volume[81881]: framework. For more detail see Apr 17 16:18:00 devstack cinder-volume[81881]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 16:18:00 devstack cinder-volume[81881]: import eventlet # noqa Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81881) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 16:18:02 devstack cinder-volume[81881]: INFO dbcounter [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Registered counter for database cinder Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_db.sqlalchemy.engines [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG dbcounter [-] [81881] Writer thread running {{(pid=81881) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 16:18:02 devstack cinder-volume[81881]: INFO cinder.rpc [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 17 16:18:02 devstack cinder-volume[81881]: INFO cinder.rpc [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_db.sqlalchemy.engines [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:18:02 devstack cinder-volume[81881]: INFO cinder.volume.manager [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Determined volume DB was empty at startup. Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG cinder.volume.manager [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81881) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 17 16:18:02 devstack cinder-volume[81881]: WARNING stevedore.named [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 16:18:02 devstack cinder-volume[81881]: WARNING castellan.key_manager [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 16:18:02 devstack cinder-volume[81881]: WARNING cinder.keymgr.conf_key_mgr [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 16:18:02 devstack cinder-volume[81881]: INFO cinder.volume.manager [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_db.sqlalchemy.engines [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:18:02 devstack cinder-volume[81881]: INFO oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Starting 1 workers Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Started child 82061 {{(pid=81881) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Full set of CONF: {{(pid=81881) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] ******************************************************************************** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Configuration options gathered from: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] ================================================================================ {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] allow_availability_zone_fallback = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] allow_compression_on_image_upload = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] allowed_direct_url_schemes = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] api_rate_limit = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] auth_strategy = keystone {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_host = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_stats_polling_interval = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backup_api_class = cinder.backup.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backup_name_template = backup-%s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backup_use_same_host = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backup_use_temp_snapshot = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] chap_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] chap_username = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_internal_tenant_project_id = 98f2aec924454f18acad75264d2fb73c {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_internal_tenant_user_id = 81365491a0a14e4e952c1ec1d0b2bb9f {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cluster = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] compression_format = gzip {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] compute_api_class = cinder.compute.nova.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:02 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] config_dir = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] config_source = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] control_exchange = openstack {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] debug = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] default_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] default_group_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] default_volume_type = QuobyteHD {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] disk_geometry = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] driver_client_cert = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] driver_client_cert_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[82061]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] driver_data_namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] driver_ssl_cert_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] driver_ssl_cert_verify = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] driver_use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] enable_new_services = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] enable_unsupported_driver = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] enabled_backends = ['QuobyteHD'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] enforce_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] filter_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_api_insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_api_ssl_compression = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_ca_certificates_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_catalog_info = image:glance:publicURL {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_num_retries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance_request_timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] goodness_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] graceful_shutdown_timeout = 5 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] group_api_class = cinder.group.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] host = devstack {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_compress_on_upload = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_conversion_address_space_limit = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_conversion_cpu_limit = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_conversion_disable = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_upload_use_cinder_backend = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_upload_use_internal_tenant = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_volume_cache_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_volume_cache_max_count = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] image_volume_cache_max_size_gb = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] init_host_max_objects_retrieval = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] instance_format = [instance: %(uuid)s] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] iscsi_target_flags = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] iscsi_write_cache = on {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] iser_helper = tgtadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] iser_ip_address = 192.168.122.132 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] iser_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_color = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_config_append = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_dir = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_options = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_rotate_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_rotate_interval_type = days {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] log_rotation_type = none {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] max_age = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] max_logfile_count = 30 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] max_logfile_size_mb = 200 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] max_over_subscription_ratio = 20.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] message_reap_interval = 86400 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] message_ttl = 2592000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] migration_create_volume_timeout_secs = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] monkey_patch = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] monkey_patch_modules = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] my_ip = 192.168.122.132 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] no_snapshot_gb_quota = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] num_iser_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] num_shell_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] num_volume_device_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] nvmeof_conn_info_version = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] nvmet_ns_id = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] nvmet_port_id = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] osapi_max_limit = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] osapi_volume_ext_list = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] osapi_volume_listen = 0.0.0.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] osapi_volume_listen_port = 8776 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] osapi_volume_use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] osapi_volume_workers = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] per_volume_size_limit = -1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] periodic_fuzzy_delay = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] periodic_interval = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] project_id_regex = [0-9a-f\-]+ {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] public_endpoint = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] publish_errors = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Starting volume driver QuobyteDriver (1.1.14) Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] quota_backup_gigabytes = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] quota_backups = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] quota_gigabytes = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] quota_groups = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] quota_snapshots = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] quota_volumes = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] rate_limit_burst = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] rate_limit_except_level = CRITICAL {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] rate_limit_interval = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] reinit_driver_count = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] replication_device = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] report_discard_supported = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] report_interval = 120 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] reservation_clean_interval = 86400 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] reservation_expire = 86400 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] reserved_image_namespaces = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] reserved_percentage = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] rpc_response_timeout = 120 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82061) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] run_external_periodic_tasks = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] scst_target_driver = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] scst_target_iqn_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_down_time = 720 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] shell_completion = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] snapshot_name_template = snapshot-%s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] state_path = /opt/stack/data/cinder {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] storage_availability_zone = nova {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] storage_protocol = iSCSI {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] syslog_log_facility = LOG_USER {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] target_helper = lioadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] target_ip_address = 192.168.122.132 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] target_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] target_protocol = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] target_secondary_ip_addresses = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] trace_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] transfer_api_class = cinder.transfer.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] transport_url = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] until_refresh = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] use_chap_auth = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] use_default_quota_class = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] use_journal = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] use_json = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] use_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] use_stderr = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] use_syslog = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] verify_glance_signatures = enabled {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_api_class = cinder.volume.api.API {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_backend_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_clear = zero {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_clear_ionice = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_clear_size = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_copy_bps_limit = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_dd_blocksize = 1M {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack quobyte-client[82064]: Reading configuration file: /etc/quobyte/client.cfg Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_name_template = volume-%s {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_service_inithost_offload = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volume_usage_audit_period = month {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] zoning_mode = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 16:18:03 devstack quobyte-client[82064]: Invalid parameters found, error: missing mount point. Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack quobyte-client[82064]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_concurrency.disable_process_locking = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.admin_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack quobyte-client[82064]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.admin_token = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.admin_user = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_admin_prefix = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_port = 35357 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_protocol = https {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_type = password {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_uri = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.auth_version = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.cache = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.delay_auth_decision = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack sudo[82092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.http_connect_timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.identity_uri = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.include_service_catalog = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack sudo[82092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.interface = public {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_password = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcache_username = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.region_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.service_token_roles_required = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.service_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.token_cache_time = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.backend = dogpile.cache.null {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.backend_argument = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.backend_expiration_time = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.config_prefix = cache.oslo {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.debug_cache_backend = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.enable_retry_client = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.enable_socket_keepalive = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.enforce_fips_mode = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.expiration_time = 600 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.hashclient_retry_attempts = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.memcache_dead_retry = 300 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.memcache_pool_maxsize = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.memcache_sasl_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.proxies = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.redis_db = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.redis_sentinel_service_name = mymaster {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.redis_server = localhost:6379 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.retry_attempts = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.retry_delay = 0.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.socket_keepalive_count = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.socket_keepalive_idle = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.socket_keepalive_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.socket_timeout = 1.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.tls_allowed_ciphers = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.tls_cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.tls_certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.tls_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.tls_keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cache.username = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] coordination.backend_url = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.asyncio_connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.asyncio_slave_connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.backend = sqlalchemy {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.connection_debug = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.connection_parameters = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.connection_recycle_time = 3600 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.connection_trace = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.db_inc_retry_interval = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.db_max_retries = 20 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.db_max_retry_interval = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.db_retry_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.max_overflow = 50 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.max_pool_size = 5 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.max_retries = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.mysql_wsrep_sync_wait = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.pool_timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.retry_interval = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.slave_connection = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.sqlite_synchronous = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.synchronous_reader = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] database.use_db_reconnect = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.connection_string = messaging:// {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.es_doc_type = notification {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.es_scroll_size = 10000 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.es_scroll_time = 2m {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.filter_error_trace = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.hmac_keys = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.sentinel_service_name = mymaster {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.socket_timeout = 0.1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.trace_requests = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler.trace_sqlalchemy = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler_jaeger.process_tags = {} {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler_jaeger.service_name_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] profiler_otlp.service_name_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.enforce_new_defaults = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: WARNING oslo_config.cfg [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.enforce_scope = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.policy_default_rule = default {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.policy_file = policy.yaml {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_policy.remote_timeout = 60.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] privsep_osbrick.group = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] privsep_osbrick.helper_command = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] privsep_osbrick.user = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_sys_admin.group = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_sys_admin.helper_command = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82061) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 17 16:18:03 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 17 16:18:03 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Running cmd (subprocess): mount.quobyte {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] cinder_sys_admin.user = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.auth_type = password {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.send_service_user_token = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] service_user.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.auth_type = password {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.region_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] glance.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.backend_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.chap_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.chap_username = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.disk_geometry = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.driver_client_cert = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.driver_client_cert_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.driver_data_namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.driver_use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.enable_unsupported_driver = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.extra_capabilities = {} {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.filter_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.goodness_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.iscsi_target_flags = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.iscsi_write_cache = on {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.iser_helper = tgtadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.iser_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_host = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_login = admin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_mount_options = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_private_key = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_share_path = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_ssh_port = 22 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.num_shell_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.nvmet_port_id = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.quobyte_client_cfg = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.quobyte_volume_url = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.replication_device = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.report_discard_supported = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.reserved_percentage = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.scst_target_driver = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.scst_target_iqn_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.storage_protocol = iSCSI {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.target_helper = tgtadm {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.target_port = 3260 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.target_protocol = iscsi {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.trace_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.unique_fqdn_network = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.use_chap_auth = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_backend_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_clear = zero {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_clear_ionice = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_clear_size = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_reports.file_event_handler = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_reports.log_dir = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.backend_availability_zone = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.backend_host = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.chap_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.chap_username = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.chiscsi_conf = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.disk_geometry = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.driver_client_cert = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.driver_client_cert_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.driver_data_namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.driver_use_ssl = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.extra_capabilities = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.filter_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.goodness_function = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.iscsi_target_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.iscsi_write_cache = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.iser_helper = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.iser_ip_address = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.iser_port = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.iser_target_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_host = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_login = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_mount_options = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_password = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_private_key = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_share_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_ssh_port = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.num_shell_tries = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nvmet_ns_id = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.nvmet_port_id = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.replication_device = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.report_discard_supported = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.reserved_percentage = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.scst_target_driver = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.storage_protocol = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.target_helper = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.target_ip_address = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.target_port = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.target_prefix = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.target_protocol = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.trace_flags = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.unique_fqdn_network = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.use_chap_auth = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_clear = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_clear_ionice = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_clear_size = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] QuobyteHD.volumes_dir = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.ssl_version = {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_notifications.driver = [] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_notifications.retry = -1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] oslo_messaging_notifications.transport_url = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] key_manager.fixed_key = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.barbican_api_version = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.barbican_endpoint = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.barbican_endpoint_type = public {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.barbican_region_name = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.number_of_retries = 60 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.retry_delay = 1 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.send_service_user_token = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.verify_ssl = True {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican.verify_ssl_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.auth_section = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.auth_type = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.cafile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.certfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.collect_timing = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.insecure = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.keyfile = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.split_loggers = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] barbican_service_user.timeout = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.approle_role_id = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.approle_secret_id = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.kv_mountpoint = secret {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.kv_path = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.kv_version = 2 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.namespace = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.root_token_id = **** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.ssl_ca_crt_file = None {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.timeout = 60.0 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.use_ssl = False {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 16:18:03 devstack cinder-volume[81881]: DEBUG oslo_service.backend._eventlet.service [None req-497b0de7-b0ee-443e-9389-3af3bde9000a None None] ******************************************************************************** {{(pid=81881) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.416s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:18:03 devstack cinder-volume[82061]: INFO cinder.volume.driver [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Driver hasn't implemented _init_vendor_properties() Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.volume.driver [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82061) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 17 16:18:03 devstack sudo[82092]: pam_unix(sudo:session): session closed for user root Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_db.sqlalchemy.engines [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writer thread running {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.db.sqlalchemy.api [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Building query based on filter {{(pid=82061) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82061) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:18:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:18:03 devstack cinder-volume[82061]: INFO cinder.keymgr.migration [None req-7ea5b65e-818f-470c-ba80-a23e882184be None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 17 16:18:03 devstack sudo[82116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:18:03 devstack sudo[82116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:18:04 devstack sudo[82116]: pam_unix(sudo:session): session closed for user root Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.395s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:18:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Driver initialization completed successfully. Apr 17 16:18:04 devstack cinder-volume[82061]: INFO cinder.manager [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Initiating service 3 cleanup Apr 17 16:18:04 devstack cinder-volume[82061]: INFO cinder.manager [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Service 3 cleanup completed. Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG cinder.service [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Creating RPC server for service cinder-volume {{(pid=82061) start /opt/stack/cinder/cinder/service.py:231}} Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG cinder.service [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82061) start /opt/stack/cinder/cinder/service.py:237}} Apr 17 16:18:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:18:04 devstack sudo[82127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:18:04 devstack sudo[82127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:18:04 devstack sudo[82127]: pam_unix(sudo:session): session closed for user root Apr 17 16:18:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.407s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:18:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1f86c02c-7381-4e8c-b910-fd3a5e6f787b None None] Driver post RPC initialization completed successfully. Apr 17 16:18:12 devstack cinder-volume[81881]: DEBUG dbcounter [-] [81881] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81881) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:18:13 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:18:14 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=4 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:19:01 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Flow 'volume_create_manager' (2de2778b-a5ba-4398-ae53-3aa698c1bc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a660d3-db34-4fc8-ad04-0259650e57a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a660d3-db34-4fc8-ad04-0259650e57a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-277494075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92f01a3-ae06-4146-bf0d-368060780861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417bfa458dbb41b8b412be755ccde2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:02Z,use_quota=True,user_id='f707c2a36c714a1ba7a4c4c10bc50bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f4a552-a7f9-43c0-82a1-9d6e81e3f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f4a552-a7f9-43c0-82a1-9d6e81e3f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9e86ac-fe48-4f6d-9285-3798b745e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9e86ac-fe48-4f6d-9285-3798b745e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92f01a3-ae06-4146-bf0d-368060780861', 'volume_name': 'volume-d92f01a3-ae06-4146-bf0d-368060780861', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852a1bf6-9042-4fef-b92d-be07a2914e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852a1bf6-9042-4fef-b92d-be07a2914e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3786df87-8930-4da4-a9d2-53e8da38bdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Volume d92f01a3-ae06-4146-bf0d-368060780861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92f01a3-ae06-4146-bf0d-368060780861', 'volume_size': 1} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-277494075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92f01a3-ae06-4146-bf0d-368060780861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417bfa458dbb41b8b412be755ccde2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:02Z,use_quota=True,user_id='f707c2a36c714a1ba7a4c4c10bc50bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Creating volume d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:02 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:02 devstack sudo[82560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 1073741824 Apr 17 16:19:02 devstack sudo[82560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Flow 'volume_create_manager' (56b84524-3f79-486e-add5-8255dae7f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07386014-a39e-4893-8b4e-93ae859b079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07386014-a39e-4893-8b4e-93ae859b079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-834905853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deca9aae-d274-47c5-b915-4738c3a1037e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af8ca24a8d7450d9ff8dcd48ee60763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:02Z,use_quota=True,user_id='29552551b341454286e25c0629f7e2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c34695-0d53-48ab-806c-18c324945392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c34695-0d53-48ab-806c-18c324945392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b1ba3b-d524-4626-8735-21636735adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b1ba3b-d524-4626-8735-21636735adb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deca9aae-d274-47c5-b915-4738c3a1037e', 'volume_name': 'volume-deca9aae-d274-47c5-b915-4738c3a1037e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17614d5-3056-497e-80c3-ca4d92ee1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17614d5-3056-497e-80c3-ca4d92ee1605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0ffba-14d3-4371-ad88-faeb8b7969ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:02 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Volume deca9aae-d274-47c5-b915-4738c3a1037e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deca9aae-d274-47c5-b915-4738c3a1037e', 'volume_size': 1} Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1cebc60c-8bc3-41ad-833b-2434935ba84e tempest-GroupSnapshotsTest-717543183 None] Group tempest-GroupSnapshotsTest-Group-1055008841: creating Apr 17 16:19:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1cebc60c-8bc3-41ad-833b-2434935ba84e tempest-GroupSnapshotsTest-717543183 None] Group tempest-GroupSnapshotsTest-Group-1055008841: created successfully Apr 17 16:19:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1cebc60c-8bc3-41ad-833b-2434935ba84e tempest-GroupSnapshotsTest-717543183 None] Create group completed successfully. Apr 17 16:19:02 devstack sudo[82560]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 1073741824" returned: 0 in 0.937s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:03 devstack sudo[82889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 Apr 17 16:19:03 devstack sudo[82889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (c3b40fb3-9765-4d07-8b90-1bed0dab1d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb26106-9281-46ea-8ae8-3ccfca5f17ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb26106-9281-46ea-8ae8-3ccfca5f17ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-429831257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=915bfc1a-0cea-453d-a6db-9bb7f57e7dde,host='devstack@QuobyteHD#QuobyteHD',id=b01a41cd-8bdf-4be7-b852-bd0c63ec36cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:04Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c5e7f23-a29d-49e8-a87d-09e764e02eb8),volume_type_id=9c5e7f23-a29d-49e8-a87d-09e764e02eb8)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85375bb0-6ce9-4e04-8b37-a9deae80624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85375bb0-6ce9-4e04-8b37-a9deae80624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea24e5c0-cfd0-4bf8-9045-00625eea3e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea24e5c0-cfd0-4bf8-9045-00625eea3e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01a41cd-8bdf-4be7-b852-bd0c63ec36cd', 'volume_name': 'volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bf4c81-d4e6-4a3f-802f-49115941e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bf4c81-d4e6-4a3f-802f-49115941e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6347cb-5691-44c0-8b32-838493730517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Volume b01a41cd-8bdf-4be7-b852-bd0c63ec36cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd', 'volume_size': 1} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:03 devstack sudo[82889]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861" returned: 0 in 0.773s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-834905853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deca9aae-d274-47c5-b915-4738c3a1037e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af8ca24a8d7450d9ff8dcd48ee60763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:02Z,use_quota=True,user_id='29552551b341454286e25c0629f7e2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Creating volume deca9aae-d274-47c5-b915-4738c3a1037e {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:03 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3786df87-8930-4da4-a9d2-53e8da38bdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92f01a3-ae06-4146-bf0d-368060780861', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:03 devstack sudo[82898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e 1073741824 Apr 17 16:19:03 devstack sudo[82898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73dccf5-20f7-4c73-be3c-b6de4b3e1493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Volume volume-d92f01a3-ae06-4146-bf0d-368060780861 (d92f01a3-ae06-4146-bf0d-368060780861): created successfully Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73dccf5-20f7-4c73-be3c-b6de4b3e1493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Flow 'volume_create_manager' (2de2778b-a5ba-4398-ae53-3aa698c1bc83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-39545869-0471-4b8f-a0bb-4d0c5e8db817 req-d2099511-1e61-48d7-953a-8cb53e9fbda8 tempest-VolumesSnapshotsTestJSON-368679851 None] Created volume successfully. Apr 17 16:19:04 devstack sudo[82898]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e 1073741824" returned: 0 in 0.525s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:04 devstack sudo[82903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e Apr 17 16:19:04 devstack sudo[82903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:05 devstack sudo[82903]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e" returned: 0 in 0.790s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=915bfc1a-0cea-453d-a6db-9bb7f57e7dde,created_at=2026-04-17T14:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-429831257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=915bfc1a-0cea-453d-a6db-9bb7f57e7dde,host='devstack@QuobyteHD#QuobyteHD',id=b01a41cd-8bdf-4be7-b852-bd0c63ec36cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:04Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c5e7f23-a29d-49e8-a87d-09e764e02eb8),volume_type_id=9c5e7f23-a29d-49e8-a87d-09e764e02eb8)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Creating volume b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:05 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0ffba-14d3-4371-ad88-faeb8b7969ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deca9aae-d274-47c5-b915-4738c3a1037e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0022041-c715-470c-ac1f-4736ccb57df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:05 devstack sudo[82906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd 1073741824 Apr 17 16:19:05 devstack sudo[82906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:05 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Volume volume-deca9aae-d274-47c5-b915-4738c3a1037e (deca9aae-d274-47c5-b915-4738c3a1037e): created successfully Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0022041-c715-470c-ac1f-4736ccb57df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Flow 'volume_create_manager' (56b84524-3f79-486e-add5-8255dae7f62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:05 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c02f2272-3004-4e8d-93dc-1c5c87ee63b3 tempest-VolumesAdminNegativeTest-1894024949 None] Created volume successfully. Apr 17 16:19:06 devstack sudo[82906]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd 1073741824" returned: 0 in 0.896s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:06 devstack sudo[82915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd Apr 17 16:19:06 devstack sudo[82915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Acquiring lock "cinder-deca9aae-d274-47c5-b915-4738c3a1037e-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Lock "cinder-deca9aae-d274-47c5-b915-4738c3a1037e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Acquiring lock "cinder-quobyte-deca9aae-d274-47c5-b915-4738c3a1037e" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Lock "cinder-quobyte-deca9aae-d274-47c5-b915-4738c3a1037e" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:06 devstack cinder-volume[82061]: INFO oslo.privsep.daemon [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp57gdrp92/privsep.sock'] Apr 17 16:19:06 devstack sudo[82917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp57gdrp92/privsep.sock Apr 17 16:19:06 devstack sudo[82917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 16:19:06 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 17 16:19:06 devstack sudo[82915]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" returned: 0 in 0.678s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.067s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Creating offline snapshot 59b53f90-0713-4d0a-bc90-72df0623ee53 of volume d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6347cb-5691-44c0-8b32-838493730517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba6e48a-9c22-4144-83bc-9160656327d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:06 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Volume volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd (b01a41cd-8bdf-4be7-b852-bd0c63ec36cd): created successfully Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba6e48a-9c22-4144-83bc-9160656327d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (c3b40fb3-9765-4d07-8b90-1bed0dab1d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1f148ee9-3979-48e5-a2d4-edbed84b0bd9 tempest-GroupSnapshotsTest-717543183 None] Created volume successfully. Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 17 16:19:07 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] GroupSnapshot a58911df-8c86-4d2b-8d7a-a9528991bb05: creating. Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Group snapshot a58911df-8c86-4d2b-8d7a-a9528991bb05: creating. {{(pid=82061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:07 devstack sudo[82917]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:07 devstack cinder-volume[82061]: INFO oslo.privsep.daemon [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Spawned new privsep daemon via rootwrap Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Accepted privsep connection to /tmp/tmp57gdrp92/privsep.sock {{(pid=82061) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 17 16:19:07 devstack cinder-volume[82061]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 17 16:19:07 devstack cinder-volume[82061]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 17 16:19:07 devstack cinder-volume[82061]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 17 16:19:07 devstack cinder-volume[82061]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82925 Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e49fd7-d396-4398-b393-327491795d80]: (2,) {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:07 devstack cinder-volume[82061]: WARNING oslo_privsep.priv_context [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] privsep daemon already running Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4e525a-f7be-4a46-86cb-d411e72fdbd6]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4510fd-623a-4970-b898-d21a044efdac]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:07 devstack sudo[82928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 Apr 17 16:19:07 devstack sudo[82928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:07 devstack sudo[82929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e Apr 17 16:19:07 devstack sudo[82929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:08 devstack sudo[82929]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e" returned: 0 in 0.541s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:08 devstack sudo[82928]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861" returned: 0 in 0.573s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:08 devstack sudo[82939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e Apr 17 16:19:08 devstack sudo[82939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:08 devstack sudo[82940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 1G Apr 17 16:19:08 devstack sudo[82940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:08 devstack sudo[82939]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-deca9aae-d274-47c5-b915-4738c3a1037e" returned: 0 in 0.553s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Lock "cinder-quobyte-deca9aae-d274-47c5-b915-4738c3a1037e" released by "delete_volume" :: held 2.360s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:08 devstack cinder-volume[82061]: WARNING cinder.quota [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:08 devstack cinder-volume[82061]: WARNING cinder.quota [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:08 devstack sudo[82940]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Created reservations ['d842f9ea-7775-49ae-a634-464a744c656d', 'f9ae04cb-d499-4006-8f67-146c6d9519e6', 'db7e120c-88df-47d4-bda6-1ca75607deac', '0de8a7ef-1c22-4fd0-ab5d-70593e9af2af'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 1G" returned: 0 in 0.656s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d92f01a3-ae06-4146-bf0d-368060780861 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:08 devstack sudo[82947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d92f01a3-ae06-4146-bf0d-368060780861 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 Apr 17 16:19:08 devstack sudo[82947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:08 devstack sudo[82949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:19:08 devstack sudo[82949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:09 devstack sudo[82947]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d92f01a3-ae06-4146-bf0d-368060780861 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:09 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 is being set with open permissions: ugo+rw Apr 17 16:19:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:09 devstack sudo[82955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 Apr 17 16:19:09 devstack sudo[82955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:09 devstack sudo[82949]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.471s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:09 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:19:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Deleted volume successfully. Apr 17 16:19:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ac37fea-17aa-4f4f-aae5-36be44a3469d tempest-VolumesAdminNegativeTest-1894024949 None] Lock "cinder-deca9aae-d274-47c5-b915-4738c3a1037e-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:10 devstack sudo[82955]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53" returned: 0 in 0.671s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:10 devstack sudo[82959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.info Apr 17 16:19:10 devstack sudo[82959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:10 devstack sudo[82959]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.info" returned: 0 in 0.491s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:10 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.info is being set with open permissions: ugo+rw Apr 17 16:19:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:10 devstack sudo[82963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.info Apr 17 16:19:10 devstack sudo[82963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:11 devstack sudo[82963]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.info" returned: 0 in 0.702s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.401s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.869s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-fd07636d-0f55-4de7-b8bf-4519b562353f req-aae0946e-3004-4fbc-8cd0-a9448c85a10d tempest-VolumesSnapshotsTestJSON-368679851 None] Create snapshot completed successfully Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Creating offline snapshot de6880b8-c603-4770-b28e-78a5b41da061 of volume b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24c1a0e-4004-4a19-b3f5-667f8412df0f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:11 devstack sudo[82992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd Apr 17 16:19:11 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "cinder-59b53f90-0713-4d0a-bc90-72df0623ee53-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-59b53f90-0713-4d0a-bc90-72df0623ee53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "cinder-quobyte-d92f01a3-ae06-4146-bf0d-368060780861" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-quobyte-d92f01a3-ae06-4146-bf0d-368060780861" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "cinder-quobyte-59b53f90-0713-4d0a-bc90-72df0623ee53" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-quobyte-59b53f90-0713-4d0a-bc90-72df0623ee53" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Deleting offline snapshot 59b53f90-0713-4d0a-bc90-72df0623ee53 of volume d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] snapshot_file for this snap is: volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[215c5c78-2121-4881-8111-da6a1bbcb7f0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:11 devstack sudo[82995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 Apr 17 16:19:11 devstack sudo[82995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:12 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" returned: 0 in 0.686s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:12 devstack sudo[83000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 1G Apr 17 16:19:12 devstack sudo[83000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Flow 'volume_create_manager' (68ea9920-baac-495f-8b9f-54331701cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3c558f-4265-4bee-8dea-03903e8ba096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3c558f-4265-4bee-8dea-03903e8ba096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:12Z,deleted=False,deleted_at=None,display_description='',display_name='789e835a-bbe4-4c60-884a-4b974f38f278-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ea3867-4710-4414-a812-943c6cbe7581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de01b8352384035be0182adeed4a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:13Z,use_quota=True,user_id='7a868d3aa71d4947aca51db91774d006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c20c4e7-05a4-4058-8584-51e2b8a357fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c20c4e7-05a4-4058-8584-51e2b8a357fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c57a63e-6f8c-446e-9af1-2105d480ddae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c57a63e-6f8c-446e-9af1-2105d480ddae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ea3867-4710-4414-a812-943c6cbe7581', 'volume_name': 'volume-a6ea3867-4710-4414-a812-943c6cbe7581', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0922a54-405f-4de3-ac00-761cd3cd1e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0922a54-405f-4de3-ac00-761cd3cd1e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf4d774-8697-48be-b810-93fccf42e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:12 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Volume a6ea3867-4710-4414-a812-943c6cbe7581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ea3867-4710-4414-a812-943c6cbe7581', 'volume_size': 1} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:12 devstack sudo[82995]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53" returned: 0 in 1.081s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d92f01a3-ae06-4146-bf0d-368060780861(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbc816e-4f75-41ec-816c-0ac81f5948c0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:12 devstack sudo[83000]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 1G" returned: 0 in 0.940s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:13 devstack sudo[83011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 Apr 17 16:19:13 devstack sudo[83011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:13 devstack sudo[83009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 Apr 17 16:19:13 devstack sudo[83009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:13 devstack sudo[83009]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861" returned: 0 in 0.768s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:13 devstack sudo[83011]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061" returned: 0 in 0.664s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:13 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:19:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:13 devstack sudo[83024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 Apr 17 16:19:13 devstack sudo[83024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:13 devstack sudo[83026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 Apr 17 16:19:13 devstack sudo[83026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:14 devstack sudo[83026]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:14 devstack sudo[83024]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53" returned: 0 in 0.474s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:14 devstack sudo[83032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.info Apr 17 16:19:14 devstack sudo[83032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:14 devstack sudo[83033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53 Apr 17 16:19:14 devstack sudo[83033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:14 devstack sudo[83032]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.info" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:14 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:14 devstack sudo[83033]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861.59b53f90-0713-4d0a-bc90-72df0623ee53" returned: 0 in 0.465s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:14 devstack sudo[83038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.info Apr 17 16:19:14 devstack sudo[83038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-quobyte-59b53f90-0713-4d0a-bc90-72df0623ee53" released by "_delete_snapshot" :: held 2.866s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-quobyte-d92f01a3-ae06-4146-bf0d-368060780861" released by "delete_snapshot" :: held 2.908s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:14 devstack cinder-volume[82061]: WARNING cinder.quota [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG cinder.quota [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Created reservations ['a4ba8331-f56a-4fed-9d11-87cd03c97482', 'edb8bbf9-8753-4902-b849-72599fdf124c', '21e52441-1584-43f3-8502-25f803965d1c', '367262f7-17c1-409f-88d3-7045d35ee3e4'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Delete snapshot completed successfully. Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-62d8b4db-dea7-4ef5-a8a6-dfd1812d42d1 req-d8332bf4-ceeb-4689-9f61-7858950e773e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-59b53f90-0713-4d0a-bc90-72df0623ee53-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "cinder-d92f01a3-ae06-4146-bf0d-368060780861-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-d92f01a3-ae06-4146-bf0d-368060780861-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "cinder-quobyte-d92f01a3-ae06-4146-bf0d-368060780861" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-quobyte-d92f01a3-ae06-4146-bf0d-368060780861" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[85910de5-4ef9-4d7a-99fd-d517621a6070]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:15 devstack sudo[83038]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.info" returned: 0 in 0.488s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.764s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.343s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:12Z,deleted=False,deleted_at=None,display_description='',display_name='789e835a-bbe4-4c60-884a-4b974f38f278-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ea3867-4710-4414-a812-943c6cbe7581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de01b8352384035be0182adeed4a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:13Z,use_quota=True,user_id='7a868d3aa71d4947aca51db91774d006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Creating volume a6ea3867-4710-4414-a812-943c6cbe7581 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:15 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:15 devstack sudo[83042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 1073741824 Apr 17 16:19:15 devstack sudo[83042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:15 devstack sudo[83041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 Apr 17 16:19:15 devstack sudo[83041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:15 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f59e32f7-ff3a-4144-93a4-c14df7b0cd57 tempest-GroupSnapshotsTest-717543183 None] group_snapshot a58911df-8c86-4d2b-8d7a-a9528991bb05: created successfully Apr 17 16:19:15 devstack sudo[83042]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 1073741824" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:15 devstack sudo[83041]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861" returned: 0 in 0.662s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:15 devstack sudo[83052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 Apr 17 16:19:15 devstack sudo[83052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:15 devstack sudo[83053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861 Apr 17 16:19:15 devstack sudo[83053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:16 devstack sudo[83052]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581" returned: 0 in 0.539s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf4d774-8697-48be-b810-93fccf42e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ea3867-4710-4414-a812-943c6cbe7581', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24959c35-62b6-487f-9521-806733d67be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:16 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Volume volume-a6ea3867-4710-4414-a812-943c6cbe7581 (a6ea3867-4710-4414-a812-943c6cbe7581): created successfully Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24959c35-62b6-487f-9521-806733d67be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Flow 'volume_create_manager' (68ea9920-baac-495f-8b9f-54331701cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-753f1f56-dd5e-40fe-8e38-94774ffd306a tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Created volume successfully. Apr 17 16:19:16 devstack sudo[83053]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d92f01a3-ae06-4146-bf0d-368060780861" returned: 0 in 0.675s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-quobyte-d92f01a3-ae06-4146-bf0d-368060780861" released by "delete_volume" :: held 1.379s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.quota [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Created reservations ['4455ff48-523c-4699-8d89-a57c6adc7f5d', '9e722d0f-22b2-4025-aa57-c538e4e1af12', '4506ffed-3a88-4831-b027-5b104156512a', 'bea9a61d-ef34-488f-a82d-526909ffa83b'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:16 devstack sudo[83063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:19:16 devstack sudo[83063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:16 devstack sudo[83063]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.430s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.manager [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:19:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Deleted volume successfully. Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-de6880b8-c603-4770-b28e-78a5b41da061-efb1c0a2-79e6-4332-acd9-4b4d65e35287" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-de6880b8-c603-4770-b28e-78a5b41da061-efb1c0a2-79e6-4332-acd9-4b4d65e35287" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Creating volume efb1c0a2-79e6-4332-acd9-4b4d65e35287 from snapshot de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-efb1c0a2-79e6-4332-acd9-4b4d65e35287" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-4f078c8e-f61d-4df7-86cf-7763be7dd782 req-d8ba01b1-d5fa-4eac-8c8a-651291d9ef0e tempest-VolumesSnapshotsTestJSON-368679851 None] Lock "cinder-d92f01a3-ae06-4146-bf0d-368060780861-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-efb1c0a2-79e6-4332-acd9-4b4d65e35287" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] snapshot: de6880b8-c603-4770-b28e-78a5b41da061, volume: efb1c0a2-79e6-4332-acd9-4b4d65e35287, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2f52b9-6d10-433f-8c9b-f0e9e7c75c23]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:17 devstack sudo[83066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 Apr 17 16:19:17 devstack sudo[83066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:17 devstack sudo[83066]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061" returned: 0 in 0.594s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef8d058-b641-457d-a5f0-50396a06121e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:17 devstack sudo[83071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd Apr 17 16:19:17 devstack sudo[83071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:18 devstack sudo[83071]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" returned: 0 in 0.720s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:18 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:19:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:18 devstack sudo[83109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 Apr 17 16:19:18 devstack sudo[83109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:22 devstack sudo[83109]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287" returned: 0 in 3.991s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:22 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9201ae-95ed-44d4-906b-04db8bf7d15f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:22 devstack sudo[83143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd Apr 17 16:19:22 devstack sudo[83143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:23 devstack cinder-volume[82061]: WARNING py.warnings [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 17 16:19:23 devstack cinder-volume[82061]: .first() Apr 17 16:19:23 devstack cinder-volume[82061]: Apr 17 16:19:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:23 devstack sudo[83143]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" returned: 0 in 1.065s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:23 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:19:23 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Converted 1024.00 MB image at 256.49 MB/s Apr 17 16:19:23 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:19:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:23 devstack sudo[83159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 Apr 17 16:19:23 devstack sudo[83159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:24 devstack sudo[83159]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287" returned: 0 in 0.557s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-efb1c0a2-79e6-4332-acd9-4b4d65e35287" released by "_copy_volume_from_snapshot" :: held 7.007s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-de6880b8-c603-4770-b28e-78a5b41da061-efb1c0a2-79e6-4332-acd9-4b4d65e35287" released by "_create_volume_from_snapshot" :: held 7.037s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.051s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.872s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[10803851-5ffb-4ee2-94b3-59e734170279]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:24 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-65489719-43d6-4235-ad85-92dae27d4af6 tempest-GroupSnapshotsTest-717543183 None] Create group from source-snapshot-a58911df-8c86-4d2b-8d7a-a9528991bb05 completed successfully. Apr 17 16:19:24 devstack sudo[83162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 Apr 17 16:19:24 devstack sudo[83162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-efb1c0a2-79e6-4332-acd9-4b4d65e35287" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-efb1c0a2-79e6-4332-acd9-4b4d65e35287" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:24 devstack sudo[83162]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581" returned: 0 in 0.842s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d4ac3-4922-4b93-9eb1-d3e8b5dae947]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4', 'name': 'volume-a6ea3867-4710-4414-a812-943c6cbe7581', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11711704-c241-4619-8bc8-bbd5e25551d9', 'enforce_multipath': True} {{(pid=82061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 17 16:19:25 devstack sudo[83167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 Apr 17 16:19:25 devstack sudo[83167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-77f1fe2d-6324-4265-87ae-e9fdcfcb430e req-3a736253-5bc9-4616-ad6d-f797595cb4be tempest-ServerBootFromVolumeStableRescueTest-802258104 None] attachment_update completed successfully. Apr 17 16:19:25 devstack sudo[83167]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287" returned: 0 in 0.615s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:25 devstack sudo[83173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287 Apr 17 16:19:25 devstack sudo[83173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:26 devstack sudo[83173]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-efb1c0a2-79e6-4332-acd9-4b4d65e35287" returned: 0 in 0.601s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-efb1c0a2-79e6-4332-acd9-4b4d65e35287" released by "delete_volume" :: held 1.269s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Created reservations ['cadddf00-d558-417d-bc1a-f37651245637'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:26 devstack cinder-volume[82061]: WARNING cinder.quota [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-549525133 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-549525133, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:26 devstack cinder-volume[82061]: WARNING cinder.quota [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-549525133 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-549525133, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Created reservations ['fc43bf5e-c7c4-4061-b202-c5e70a89562f', '451be339-eec7-4fe3-95c7-b3d0679082fd', 'ef9ab570-4c4f-4bac-920b-3816bda51327', 'f2c5ba15-4329-4591-a753-f4d5ca8c8f74'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:26 devstack sudo[83179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:19:26 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:26 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:26 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:19:26 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-32eada6c-4897-492b-ab0d-416c54a998aa tempest-GroupSnapshotsTest-717543183 None] Delete group completed successfully. Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3eabb3e6-2450-4755-a0b8-ea2d5272e2b8 tempest-BackendsCapabilitiesAdminTestsJSON-98061753 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82061) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 17 16:19:27 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] group_snapshot a58911df-8c86-4d2b-8d7a-a9528991bb05: deleting Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] group_snapshot a58911df-8c86-4d2b-8d7a-a9528991bb05: deleting {{(pid=82061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-de6880b8-c603-4770-b28e-78a5b41da061" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-de6880b8-c603-4770-b28e-78a5b41da061" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Deleting offline snapshot de6880b8-c603-4770-b28e-78a5b41da061 of volume b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] snapshot_file for this snap is: volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b0a1e3-d827-463a-bc32-0344a7720d26]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:27 devstack sudo[83251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 Apr 17 16:19:27 devstack sudo[83251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-28a6f6ca-1284-4572-b047-dfabc808121b tempest-BackendsCapabilitiesAdminTestsJSON-98061753 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82061) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 17 16:19:27 devstack sudo[83251]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061" returned: 0 in 0.529s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[169feb72-bea9-45ed-ab41-307636734a53]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:28 devstack sudo[83256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd Apr 17 16:19:28 devstack sudo[83256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:28 devstack sudo[83256]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" returned: 0 in 0.661s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:28 devstack sudo[83265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 Apr 17 16:19:28 devstack sudo[83265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:29 devstack sudo[83265]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061" returned: 0 in 0.599s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:29 devstack sudo[83270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061 Apr 17 16:19:29 devstack sudo[83270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:29 devstack sudo[83270]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd.de6880b8-c603-4770-b28e-78a5b41da061" returned: 0 in 0.554s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-de6880b8-c603-4770-b28e-78a5b41da061" released by "_delete_snapshot" :: held 2.391s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" released by "delete_snapshot" :: held 2.402s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:29 devstack cinder-volume[82061]: WARNING cinder.quota [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-549525133 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-549525133, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:29 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] Created reservations ['2950a9d0-885a-4feb-aec8-6a9739da3bc8', '2f7c2e7f-77b8-4129-bace-bda7ee2ebf1f', '4ecd6c22-6c71-4a3e-bc74-013080b87b42', '3b756163-7bdf-4d73-9f8e-902fa5204210'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:29 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-56ba85e3-b906-4463-b29a-aee219d1d75e tempest-GroupSnapshotsTest-717543183 None] group_snapshot a58911df-8c86-4d2b-8d7a-a9528991bb05: deleted successfully Apr 17 16:19:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:30 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17f6923-6ee0-4617-aece-645684428e38]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:31 devstack sudo[83615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd Apr 17 16:19:31 devstack sudo[83615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:31 devstack sudo[83615]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" returned: 0 in 0.645s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:31 devstack sudo[83621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd Apr 17 16:19:31 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:32 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" returned: 0 in 0.588s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-b01a41cd-8bdf-4be7-b852-bd0c63ec36cd" released by "delete_volume" :: held 1.281s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['1812f29d-4c7e-4753-a552-77f9d43f7d2a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:32 devstack cinder-volume[82061]: WARNING cinder.db.sqlalchemy.api [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-549525133'] Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['6eb710aa-09eb-4779-843f-1f6bab95b0a4', 'a318a307-cd6c-48a9-8e9f-4a2233a31ef6', '5b516e90-22fd-4232-876a-f9393563f91a', 'ec843bfd-d2d8-4550-b1f0-7d29a9d3c5d3'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:32 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:19:32 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:32 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.534s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:32 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:19:32 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4c94c94d-6188-4fb1-93da-4a6952d4b928 tempest-GroupSnapshotsTest-717543183 None] Delete group completed successfully. Apr 17 16:19:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:19:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:33 devstack sudo[83629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:19:33 devstack sudo[83629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-86bc071d-c75c-4749-92bf-1342331920ec tempest-GroupSnapshotsTest-717543183 None] Group tempest-GroupSnapshotsTest-Group-1590140146: creating Apr 17 16:19:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-86bc071d-c75c-4749-92bf-1342331920ec tempest-GroupSnapshotsTest-717543183 None] Group tempest-GroupSnapshotsTest-Group-1590140146: created successfully Apr 17 16:19:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-86bc071d-c75c-4749-92bf-1342331920ec tempest-GroupSnapshotsTest-717543183 None] Create group completed successfully. Apr 17 16:19:34 devstack sudo[83629]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.657s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (e68fafe1-963c-4179-a25d-e7dfa5b7b25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62f4d48-c535-494d-80be-66341d957898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62f4d48-c535-494d-80be-66341d957898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-742236396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cbe40bc-8602-41a9-8c4e-78d96bc92da8,host='devstack@QuobyteHD#QuobyteHD',id=44ae4c1d-b757-4b21-b812-f2bd2d92d5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:35Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd64ba3d-46cc-4542-9071-874aaeb1feab),volume_type_id=cd64ba3d-46cc-4542-9071-874aaeb1feab)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579d4321-821a-4d80-8117-d3b17546d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579d4321-821a-4d80-8117-d3b17546d87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6788e41e-6e9e-42fb-8adc-49376586a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6788e41e-6e9e-42fb-8adc-49376586a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ae4c1d-b757-4b21-b812-f2bd2d92d5e8', 'volume_name': 'volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9298256b-6dd3-44c3-967e-ed34f8aa640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9298256b-6dd3-44c3-967e-ed34f8aa640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14482819-2893-4088-a830-02b2b705535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:35 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Volume 44ae4c1d-b757-4b21-b812-f2bd2d92d5e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8', 'volume_size': 1} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5cbe40bc-8602-41a9-8c4e-78d96bc92da8,created_at=2026-04-17T14:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-742236396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cbe40bc-8602-41a9-8c4e-78d96bc92da8,host='devstack@QuobyteHD#QuobyteHD',id=44ae4c1d-b757-4b21-b812-f2bd2d92d5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:35Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd64ba3d-46cc-4542-9071-874aaeb1feab),volume_type_id=cd64ba3d-46cc-4542-9071-874aaeb1feab)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Creating volume 44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:35 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:35 devstack sudo[83633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 1073741824 Apr 17 16:19:35 devstack sudo[83633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:35 devstack sudo[83633]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 1073741824" returned: 0 in 0.687s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:36 devstack sudo[83638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 Apr 17 16:19:36 devstack sudo[83638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:36 devstack sudo[83638]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" returned: 0 in 0.506s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14482819-2893-4088-a830-02b2b705535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2087058c-c376-42d6-9c01-cdc661b2192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Volume volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 (44ae4c1d-b757-4b21-b812-f2bd2d92d5e8): created successfully Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2087058c-c376-42d6-9c01-cdc661b2192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (e68fafe1-963c-4179-a25d-e7dfa5b7b25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:36 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e91599a9-3a51-4a53-9876-0f3841504627 tempest-GroupSnapshotsTest-717543183 None] Created volume successfully. Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (4263ec5b-47f1-4305-9e96-3d8299fec078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cb2dd2-c178-4318-91f1-df39138af393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cb2dd2-c178-4318-91f1-df39138af393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683587358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cbe40bc-8602-41a9-8c4e-78d96bc92da8,host='devstack@QuobyteHD#QuobyteHD',id=10530889-6fb1-4317-a3d0-5d5dd439dd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:38Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd64ba3d-46cc-4542-9071-874aaeb1feab),volume_type_id=cd64ba3d-46cc-4542-9071-874aaeb1feab)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a720a6d-4b5e-48a2-a925-02119cde520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a720a6d-4b5e-48a2-a925-02119cde520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e2b42-02e2-4dd8-8bc4-091180ba4f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e2b42-02e2-4dd8-8bc4-091180ba4f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10530889-6fb1-4317-a3d0-5d5dd439dd4d', 'volume_name': 'volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f05ced-a8a1-45b0-8c2e-9f403e39e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f05ced-a8a1-45b0-8c2e-9f403e39e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5f9eef-7721-4e97-bef1-96d5d910d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:37 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Volume 10530889-6fb1-4317-a3d0-5d5dd439dd4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d', 'volume_size': 1} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5cbe40bc-8602-41a9-8c4e-78d96bc92da8,created_at=2026-04-17T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683587358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cbe40bc-8602-41a9-8c4e-78d96bc92da8,host='devstack@QuobyteHD#QuobyteHD',id=10530889-6fb1-4317-a3d0-5d5dd439dd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:38Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd64ba3d-46cc-4542-9071-874aaeb1feab),volume_type_id=cd64ba3d-46cc-4542-9071-874aaeb1feab)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Creating volume 10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:37 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:37 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d 1073741824 Apr 17 16:19:37 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:38 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d 1073741824" returned: 0 in 0.670s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:38 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d Apr 17 16:19:38 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:39 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d" returned: 0 in 0.543s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5f9eef-7721-4e97-bef1-96d5d910d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed75242e-e938-43bd-a754-4970bcd47595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:39 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Volume volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d (10530889-6fb1-4317-a3d0-5d5dd439dd4d): created successfully Apr 17 16:19:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed75242e-e938-43bd-a754-4970bcd47595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (4263ec5b-47f1-4305-9e96-3d8299fec078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:39 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-892dd152-e637-44b8-aa86-b1d7bf4beb0d tempest-GroupSnapshotsTest-717543183 None] Created volume successfully. Apr 17 16:19:40 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-9117e7da-6e2f-4102-99de-c9c6f82e73c4 tempest-GroupSnapshotsTest-717543183 None] Update group completed successfully. Apr 17 16:19:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e6372410-3153-48a7-aee0-86bf6cafe269 tempest-GroupSnapshotsTest-717543183 None] Update group completed successfully. Apr 17 16:19:42 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-81e05ed0-35a2-4c21-ba56-9b842cea419a tempest-GroupSnapshotsTest-717543183 None] Update group completed successfully. Apr 17 16:19:43 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b14a8e59-7ee7-4ff7-a998-317bacdd7ca9 tempest-GroupSnapshotsTest-717543183 None] Update group completed successfully. Apr 17 16:19:44 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] GroupSnapshot eef79619-5ed2-4d81-a3b9-175fced71abc: creating. Apr 17 16:19:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Group snapshot eef79619-5ed2-4d81-a3b9-175fced71abc: creating. {{(pid=82061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 16:19:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Creating offline snapshot 83483384-9440-41b9-94e1-80bb1e164244 of volume 44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc7c20-869c-46bc-a626-d5658c32ed93]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:45 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 Apr 17 16:19:45 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Flow 'volume_create_manager' (ed4ecff1-933f-4b1c-ad17-b7a4b3207394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c108767-a2cc-4c36-a412-89febbe606c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c108767-a2cc-4c36-a412-89febbe606c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1247674933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50081372-bcd6-4e53-afe2-a9beda422073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cedbc315754054b78ef861e222d4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:46Z,use_quota=True,user_id='f2fe55b152d34725a5fa8ac62169ea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85bdbd1-92f4-4783-be29-62afa82fc23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85bdbd1-92f4-4783-be29-62afa82fc23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454c1fd7-b944-45c0-b364-854a82c5e69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454c1fd7-b944-45c0-b364-854a82c5e69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50081372-bcd6-4e53-afe2-a9beda422073', 'volume_name': 'volume-50081372-bcd6-4e53-afe2-a9beda422073', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4142b8f7-2e4c-437e-98d9-125e9e07e84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4142b8f7-2e4c-437e-98d9-125e9e07e84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b37515-b7a3-4726-a6bc-7a4ca8506de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:45 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Volume 50081372-bcd6-4e53-afe2-a9beda422073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50081372-bcd6-4e53-afe2-a9beda422073', 'volume_size': 1} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:45 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" returned: 0 in 0.833s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:45 devstack sudo[83737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 1G Apr 17 16:19:45 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:46 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 1G" returned: 0 in 0.518s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:46 devstack sudo[83742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 Apr 17 16:19:46 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:46 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244" returned: 0 in 0.636s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:46 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:19:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:47 devstack sudo[83749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 Apr 17 16:19:47 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:47 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:47 devstack sudo[83783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.info Apr 17 16:19:47 devstack sudo[83783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:48 devstack sudo[83783]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.info" returned: 0 in 0.626s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:48 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:48 devstack sudo[83786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.info Apr 17 16:19:48 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:48 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.info" returned: 0 in 0.541s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.722s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Creating offline snapshot ae715865-1b5b-4a0f-9200-cf779046a9a6 of volume 10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[908dd47c-867e-4a10-adf9-52c21a26685a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:48 devstack sudo[83791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d Apr 17 16:19:48 devstack sudo[83791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:49 devstack sudo[83791]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d" returned: 0 in 0.607s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:49 devstack sudo[83838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 1G Apr 17 16:19:49 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:50 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 1G" returned: 0 in 0.710s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:50 devstack sudo[83867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 Apr 17 16:19:50 devstack sudo[83867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:50 devstack sudo[83867]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6" returned: 0 in 0.532s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:50 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:19:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:50 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 Apr 17 16:19:50 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:51 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6" returned: 0 in 0.505s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:51 devstack sudo[83876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.info Apr 17 16:19:51 devstack sudo[83876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:51 devstack sudo[83876]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.info" returned: 0 in 0.491s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:51 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:19:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:51 devstack sudo[83885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.info Apr 17 16:19:51 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:52 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.info" returned: 0 in 0.445s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.352s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.369s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1247674933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50081372-bcd6-4e53-afe2-a9beda422073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cedbc315754054b78ef861e222d4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:46Z,use_quota=True,user_id='f2fe55b152d34725a5fa8ac62169ea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Creating volume 50081372-bcd6-4e53-afe2-a9beda422073 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:52 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:52 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 1073741824 Apr 17 16:19:52 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:52 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0cc71e5d-9993-436e-9988-f2b5be3be897 tempest-GroupSnapshotsTest-717543183 None] group_snapshot eef79619-5ed2-4d81-a3b9-175fced71abc: created successfully Apr 17 16:19:52 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] group_snapshot eef79619-5ed2-4d81-a3b9-175fced71abc: deleting Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] group_snapshot eef79619-5ed2-4d81-a3b9-175fced71abc: deleting {{(pid=82061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-83483384-9440-41b9-94e1-80bb1e164244" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-83483384-9440-41b9-94e1-80bb1e164244" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Deleting offline snapshot 83483384-9440-41b9-94e1-80bb1e164244 of volume 44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] snapshot_file for this snap is: volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f9f41b-5510-4bb8-9af5-a422502fc5db]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:52 devstack sudo[83897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 Apr 17 16:19:52 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:52 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 1073741824" returned: 0 in 0.577s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:52 devstack sudo[83900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 Apr 17 16:19:52 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:53 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244" returned: 0 in 0.582s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[361b68c5-3b4c-4c55-944c-7dfe28f5af89]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:53 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073" returned: 0 in 0.454s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b37515-b7a3-4726-a6bc-7a4ca8506de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50081372-bcd6-4e53-afe2-a9beda422073', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e52c43-8b26-46f4-9091-850a21e17810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:53 devstack sudo[83906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 Apr 17 16:19:53 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:53 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Volume volume-50081372-bcd6-4e53-afe2-a9beda422073 (50081372-bcd6-4e53-afe2-a9beda422073): created successfully Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e52c43-8b26-46f4-9091-850a21e17810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Flow 'volume_create_manager' (ed4ecff1-933f-4b1c-ad17-b7a4b3207394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:53 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-be15cc61-642e-4207-9ad4-997a079259e6 tempest-VolumesListAdminTestJSON-1552451995 None] Created volume successfully. Apr 17 16:19:53 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" returned: 0 in 0.687s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:53 devstack sudo[83936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 Apr 17 16:19:53 devstack sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:54 devstack sudo[83936]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244" returned: 0 in 0.727s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:54 devstack sudo[83950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244 Apr 17 16:19:54 devstack sudo[83950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=90,cinder:UPDATE=74,cinder:INSERT=14,cinder:DELETE=6 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Flow 'volume_create_manager' (a9bd273f-475d-46bc-b31f-bfd60fe5d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ad4c73-5cc2-47dc-9d04-df080d742ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ad4c73-5cc2-47dc-9d04-df080d742ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1437851288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b48343b-17e8-4de9-85fc-01531af53acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cedbc315754054b78ef861e222d4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:55Z,use_quota=True,user_id='f2fe55b152d34725a5fa8ac62169ea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9dd2d17-63f2-4ed3-99e0-50bcc7dc568c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9dd2d17-63f2-4ed3-99e0-50bcc7dc568c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8ddc50-389c-4b1d-a4b6-fa5bcf016465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8ddc50-389c-4b1d-a4b6-fa5bcf016465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b48343b-17e8-4de9-85fc-01531af53acb', 'volume_name': 'volume-6b48343b-17e8-4de9-85fc-01531af53acb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88cc348-2f92-4717-ab4f-39db2ac5e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88cc348-2f92-4717-ab4f-39db2ac5e405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f530451d-3227-48d6-9d5e-a8c31d6e6f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Volume 6b48343b-17e8-4de9-85fc-01531af53acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b48343b-17e8-4de9-85fc-01531af53acb', 'volume_size': 1} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1437851288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b48343b-17e8-4de9-85fc-01531af53acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cedbc315754054b78ef861e222d4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:55Z,use_quota=True,user_id='f2fe55b152d34725a5fa8ac62169ea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Creating volume 6b48343b-17e8-4de9-85fc-01531af53acb {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:54 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:54 devstack sudo[83952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb 1073741824 Apr 17 16:19:54 devstack sudo[83952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:55 devstack sudo[83950]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8.83483384-9440-41b9-94e1-80bb1e164244" returned: 0 in 0.545s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-83483384-9440-41b9-94e1-80bb1e164244" released by "_delete_snapshot" :: held 2.597s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" released by "delete_snapshot" :: held 2.611s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=104,cinder:UPDATE=98,cinder:INSERT=23,cinder:DELETE=4 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-10530889-6fb1-4317-a3d0-5d5dd439dd4d" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-10530889-6fb1-4317-a3d0-5d5dd439dd4d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-ae715865-1b5b-4a0f-9200-cf779046a9a6" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-ae715865-1b5b-4a0f-9200-cf779046a9a6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Deleting offline snapshot ae715865-1b5b-4a0f-9200-cf779046a9a6 of volume 10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] snapshot_file for this snap is: volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fa55a2-30ae-442f-9670-ba296c778e60]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:55 devstack sudo[83958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 Apr 17 16:19:55 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:55 devstack sudo[83952]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb 1073741824" returned: 0 in 0.588s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:55 devstack sudo[83960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb Apr 17 16:19:55 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:55 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6" returned: 0 in 0.675s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef957453-2976-4341-a38a-3c4d40892d38]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:55 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f530451d-3227-48d6-9d5e-a8c31d6e6f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b48343b-17e8-4de9-85fc-01531af53acb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f22f130-d34a-44df-ba2f-b0b1b980e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:55 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Volume volume-6b48343b-17e8-4de9-85fc-01531af53acb (6b48343b-17e8-4de9-85fc-01531af53acb): created successfully Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f22f130-d34a-44df-ba2f-b0b1b980e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Flow 'volume_create_manager' (a9bd273f-475d-46bc-b31f-bfd60fe5d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3e4f42c0-eabc-4ea1-91ec-bff403606d93 tempest-VolumesListAdminTestJSON-1552451995 None] Created volume successfully. Apr 17 16:19:55 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d Apr 17 16:19:55 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Flow 'volume_create_manager' (6440bd9f-98f9-45f8-a137-a60d3c882ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ba30ff-63cc-4b4d-919a-230f2107cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ba30ff-63cc-4b4d-919a-230f2107cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-649683686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c139bae-f6ac-4c82-8b3c-6572c665c9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5106243a38404245b4ff68a34ed6b099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:56Z,use_quota=True,user_id='e767b34fa3584548a5cb43a816324187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34e5213-df61-42a5-813b-eff6b8b95100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34e5213-df61-42a5-813b-eff6b8b95100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b89a713-d2ec-4300-9729-559a41796cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b89a713-d2ec-4300-9729-559a41796cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c139bae-f6ac-4c82-8b3c-6572c665c9d5', 'volume_name': 'volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e908c369-7aa0-4d9f-be70-3af05f830121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e908c369-7aa0-4d9f-be70-3af05f830121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af1b562-378c-45de-8d1f-e280078ce366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:56 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Volume 0c139bae-f6ac-4c82-8b3c-6572c665c9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5', 'volume_size': 1} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-649683686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c139bae-f6ac-4c82-8b3c-6572c665c9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5106243a38404245b4ff68a34ed6b099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:56Z,use_quota=True,user_id='e767b34fa3584548a5cb43a816324187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Creating volume 0c139bae-f6ac-4c82-8b3c-6572c665c9d5 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:56 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:56 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 1073741824 Apr 17 16:19:56 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:56 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d" returned: 0 in 0.776s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:56 devstack sudo[83994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 Apr 17 16:19:56 devstack sudo[83994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:57 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 1073741824" returned: 0 in 0.919s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:57 devstack sudo[84017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 Apr 17 16:19:57 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Flow 'volume_create_manager' (d96e3246-a2f9-468a-85ca-72d2e190ee7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b95dc7-b062-4774-8b01-eb0ac8fca045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b95dc7-b062-4774-8b01-eb0ac8fca045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1790897308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5974fc7-1702-4150-a25b-24993ea903c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cedbc315754054b78ef861e222d4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:57Z,use_quota=True,user_id='f2fe55b152d34725a5fa8ac62169ea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9510973-1e4a-4bd1-b516-b31ac5d87d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9510973-1e4a-4bd1-b516-b31ac5d87d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca112848-eb37-406e-8fe4-6b3f8fed4cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca112848-eb37-406e-8fe4-6b3f8fed4cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5974fc7-1702-4150-a25b-24993ea903c9', 'volume_name': 'volume-b5974fc7-1702-4150-a25b-24993ea903c9', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b0e347-3989-419c-89ef-b358deb827a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b0e347-3989-419c-89ef-b358deb827a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb70f33-23fb-42cc-817f-df7a032264aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:57 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Volume b5974fc7-1702-4150-a25b-24993ea903c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5974fc7-1702-4150-a25b-24993ea903c9', 'volume_size': 1} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:57 devstack sudo[83994]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6" returned: 0 in 0.938s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:57 devstack sudo[84019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6 Apr 17 16:19:57 devstack sudo[84019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:57 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1790897308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5974fc7-1702-4150-a25b-24993ea903c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cedbc315754054b78ef861e222d4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:19:57Z,use_quota=True,user_id='f2fe55b152d34725a5fa8ac62169ea83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Creating volume b5974fc7-1702-4150-a25b-24993ea903c9 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:57 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af1b562-378c-45de-8d1f-e280078ce366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947bb785-109a-4d94-b090-3d4663f1ee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:57 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 1073741824 Apr 17 16:19:57 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:57 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Volume volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 (0c139bae-f6ac-4c82-8b3c-6572c665c9d5): created successfully Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947bb785-109a-4d94-b090-3d4663f1ee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Flow 'volume_create_manager' (6440bd9f-98f9-45f8-a137-a60d3c882ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:57 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c27f5e59-f22b-48a9-aea0-5746bc26b0e5 tempest-DeleteServersTestJSON-1660981344 None] Created volume successfully. Apr 17 16:19:58 devstack sudo[84019]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d.ae715865-1b5b-4a0f-9200-cf779046a9a6" returned: 0 in 0.609s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-ae715865-1b5b-4a0f-9200-cf779046a9a6" released by "_delete_snapshot" :: held 3.056s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-10530889-6fb1-4317-a3d0-5d5dd439dd4d" released by "delete_snapshot" :: held 3.075s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:19:58 devstack cinder-volume[82061]: WARNING cinder.quota [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-25939417 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-25939417, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:58 devstack cinder-volume[82061]: WARNING cinder.quota [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-25939417 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-25939417, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:19:58 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['db13b463-0047-4239-92bf-7550ced66de6', 'ba43469a-d48c-4b9d-bc15-2efe0a8ee2b7', 'f30160ac-51cd-4cf5-95ab-ac2bd2adc305', '7fc6364b-db0c-40c4-aa01-6358091c9f99'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:58 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['d6c39564-2e73-4972-881e-0634bc81a79a', 'cfaf03ae-c442-4d65-b69a-469e7723a872', '5c4cc173-1fee-4212-b1e0-c5a879e62c46', '1536a0b4-c593-4b28-9362-bef38e38bc99'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:19:58 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fc21ec40-9b74-4606-a6f8-df1fb03c4434 tempest-GroupSnapshotsTest-717543183 None] group_snapshot eef79619-5ed2-4d81-a3b9-175fced71abc: deleted successfully Apr 17 16:19:58 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 1073741824" returned: 0 in 0.671s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:58 devstack sudo[84048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 Apr 17 16:19:58 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:59 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9" returned: 0 in 0.532s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb70f33-23fb-42cc-817f-df7a032264aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5974fc7-1702-4150-a25b-24993ea903c9', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0695bcce-6f47-474a-a429-03f0fcd1d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:59 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Volume volume-b5974fc7-1702-4150-a25b-24993ea903c9 (b5974fc7-1702-4150-a25b-24993ea903c9): created successfully Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0695bcce-6f47-474a-a429-03f0fcd1d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Flow 'volume_create_manager' (d96e3246-a2f9-468a-85ca-72d2e190ee7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-42e9b5ab-e2a2-41da-9fe7-f2454b98baf1 tempest-VolumesListAdminTestJSON-1552451995 None] Created volume successfully. Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-10530889-6fb1-4317-a3d0-5d5dd439dd4d" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-10530889-6fb1-4317-a3d0-5d5dd439dd4d" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e064f977-63e0-40c2-9a62-10bd5b1161e0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:59 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d Apr 17 16:19:59 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:59 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d" returned: 0 in 0.543s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:59 devstack sudo[84059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d Apr 17 16:19:59 devstack sudo[84059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Flow 'volume_create_manager' (6ee17307-f86b-437a-9eb1-ec98bd9ee1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0476f0b-5375-44bb-9501-fda7c42305dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0476f0b-5375-44bb-9501-fda7c42305dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c4430e-5bc6-4f89-a090-67ae9445a3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa4a394c80b4424828e9459180546b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:00Z,use_quota=True,user_id='b346eae992ff40338418f39b64b678d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cbd824-7e53-4102-8931-3576f6600821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cbd824-7e53-4102-8931-3576f6600821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007cbeef-acf7-4498-ada9-5f96b1ba021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007cbeef-acf7-4498-ada9-5f96b1ba021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c4430e-5bc6-4f89-a090-67ae9445a3cd', 'volume_name': 'volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb43a879-9f75-4d17-9ba4-1cd705e91da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb43a879-9f75-4d17-9ba4-1cd705e91da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba882d7-505f-4bcb-a872-cced003772be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:19:59 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Volume 01c4430e-5bc6-4f89-a090-67ae9445a3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd', 'volume_size': 1} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c4430e-5bc6-4f89-a090-67ae9445a3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa4a394c80b4424828e9459180546b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:00Z,use_quota=True,user_id='b346eae992ff40338418f39b64b678d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Creating volume 01c4430e-5bc6-4f89-a090-67ae9445a3cd {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:19:59 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:19:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:19:59 devstack sudo[84061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd 1073741824 Apr 17 16:19:59 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:00 devstack sudo[84059]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10530889-6fb1-4317-a3d0-5d5dd439dd4d" returned: 0 in 0.484s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-10530889-6fb1-4317-a3d0-5d5dd439dd4d" released by "delete_volume" :: held 1.071s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59e9f16-e01e-4a49-a406-78b7c75d05aa]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:00 devstack sudo[84064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 Apr 17 16:20:00 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:00 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd 1073741824" returned: 0 in 0.594s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:00 devstack sudo[84069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd Apr 17 16:20:00 devstack sudo[84069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:00 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" returned: 0 in 0.618s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:00 devstack sudo[84076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8 Apr 17 16:20:00 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:01 devstack sudo[84069]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba882d7-505f-4bcb-a872-cced003772be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e330b531-caae-4d4e-98b4-7b54f3a333ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:01 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Volume volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd (01c4430e-5bc6-4f89-a090-67ae9445a3cd): created successfully Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e330b531-caae-4d4e-98b4-7b54f3a333ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Flow 'volume_create_manager' (6ee17307-f86b-437a-9eb1-ec98bd9ee1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:01 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fcbc6333-0c5a-458f-8480-ca7c22a7d16c tempest-VolumesListAdminTestJSON-1429591139 None] Created volume successfully. Apr 17 16:20:01 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" returned: 0 in 0.547s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-44ae4c1d-b757-4b21-b812-f2bd2d92d5e8" released by "delete_volume" :: held 1.224s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['7eae3eb5-78a7-4970-9c99-3f5463cc4779'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:01 devstack cinder-volume[82061]: WARNING cinder.quota [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-25939417 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-25939417, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['4aece339-12d4-47fa-be6d-4b27eee0a728', '65e7c31f-c503-423a-a7e3-cde97e791805', '335a81b3-bca9-48e0-965d-0d3b422ecac5', '92409420-da9a-4910-a1c9-618749369a48'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['d9179ac4-e63c-4ac8-a425-450d72df5ead', 'd51a7d97-9efd-4295-97b3-a84045823a71', '0c57abf2-2956-4cc6-aabf-e4b78612620b', '67886f83-c459-46ce-a42d-73320c1e1b66'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-5fd06ee7-e0e2-45c0-812e-2023188f4898 req-7cdfd90c-8f7a-4d73-84de-42de15f82a65 tempest-DeleteServersTestJSON-1660981344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-5fd06ee7-e0e2-45c0-812e-2023188f4898 req-7cdfd90c-8f7a-4d73-84de-42de15f82a65 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[71965d8b-3676-45ad-8233-4eabb5c58e97]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-5fd06ee7-e0e2-45c0-812e-2023188f4898 req-7cdfd90c-8f7a-4d73-84de-42de15f82a65 tempest-DeleteServersTestJSON-1660981344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:01 devstack sudo[84093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 Apr 17 16:20:01 devstack sudo[84093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:01 devstack sudo[84094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:01 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Acquiring lock "cinder-01c4430e-5bc6-4f89-a090-67ae9445a3cd-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Lock "cinder-01c4430e-5bc6-4f89-a090-67ae9445a3cd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Acquiring lock "cinder-quobyte-01c4430e-5bc6-4f89-a090-67ae9445a3cd" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Lock "cinder-quobyte-01c4430e-5bc6-4f89-a090-67ae9445a3cd" acquired by "delete_volume" :: waited 0.024s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfe63d5-4cdc-4e38-9619-6c9b062ff734]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:02 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-492450a1-9b5c-4ce0-889a-af9d58aac133 tempest-GroupSnapshotsTest-717543183 None] Delete group completed successfully. Apr 17 16:20:02 devstack sudo[84093]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-5fd06ee7-e0e2-45c0-812e-2023188f4898 req-7cdfd90c-8f7a-4d73-84de-42de15f82a65 tempest-DeleteServersTestJSON-1660981344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5" returned: 0 in 0.587s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-5fd06ee7-e0e2-45c0-812e-2023188f4898 req-7cdfd90c-8f7a-4d73-84de-42de15f82a65 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.598s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "cinder-b5974fc7-1702-4150-a25b-24993ea903c9-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-b5974fc7-1702-4150-a25b-24993ea903c9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-5fd06ee7-e0e2-45c0-812e-2023188f4898 req-7cdfd90c-8f7a-4d73-84de-42de15f82a65 tempest-DeleteServersTestJSON-1660981344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4', 'name': 'volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '931a729d-7df6-49aa-8142-8ee9b27db30e', 'enforce_multipath': True} {{(pid=82061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 17 16:20:02 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd Apr 17 16:20:02 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "cinder-quobyte-b5974fc7-1702-4150-a25b-24993ea903c9" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-quobyte-b5974fc7-1702-4150-a25b-24993ea903c9" acquired by "delete_volume" :: waited 0.048s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f7b415-df2e-4d95-bd89-96b2d03dc943]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-5fd06ee7-e0e2-45c0-812e-2023188f4898 req-7cdfd90c-8f7a-4d73-84de-42de15f82a65 tempest-DeleteServersTestJSON-1660981344 None] attachment_update completed successfully. Apr 17 16:20:02 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 Apr 17 16:20:02 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8937775d-81fb-44b9-b481-e15dc40f3af7 tempest-GroupSnapshotsTest-717543183 None] Group tempest-GroupSnapshotsTest-Group-1700421845: creating Apr 17 16:20:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8937775d-81fb-44b9-b481-e15dc40f3af7 tempest-GroupSnapshotsTest-717543183 None] Group tempest-GroupSnapshotsTest-Group-1700421845: created successfully Apr 17 16:20:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8937775d-81fb-44b9-b481-e15dc40f3af7 tempest-GroupSnapshotsTest-717543183 None] Create group completed successfully. Apr 17 16:20:02 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd" returned: 0 in 0.688s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:02 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd Apr 17 16:20:02 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:03 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9" returned: 0 in 0.876s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:03 devstack sudo[84143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9 Apr 17 16:20:03 devstack sudo[84143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:03 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01c4430e-5bc6-4f89-a090-67ae9445a3cd" returned: 0 in 0.863s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Lock "cinder-quobyte-01c4430e-5bc6-4f89-a090-67ae9445a3cd" released by "delete_volume" :: held 1.576s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Created reservations ['9ec81b2b-47e5-4145-854e-afe907c70ace', '9788139f-7142-4e68-85fe-a33c0096ac63', '6ba4b971-4e2e-4cf8-a057-91a8f7b412b9', '75ca3501-14b7-4625-b029-4ae6d6f11e76'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:03 devstack sudo[84147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:03 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (d7231ff7-4e01-4016-8027-128d192bf8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e124f10-45f5-4b33-9345-ac26f3ab3240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e124f10-45f5-4b33-9345-ac26f3ab3240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375207775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aa0f5e8-5885-4049-8975-cd10642e7c75,host='devstack@QuobyteHD#QuobyteHD',id=80e50c52-755a-42ee-b76d-d7284e2eaf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:04Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d581e0-9116-4e03-af8e-f3dbe619f809),volume_type_id=d8d581e0-9116-4e03-af8e-f3dbe619f809)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7842f4-24cf-40a3-9b45-dfa8a255fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7842f4-24cf-40a3-9b45-dfa8a255fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fa5df8-f97b-4fb3-8d7d-651df26b960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fa5df8-f97b-4fb3-8d7d-651df26b960e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e50c52-755a-42ee-b76d-d7284e2eaf10', 'volume_name': 'volume-80e50c52-755a-42ee-b76d-d7284e2eaf10', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd9a787-e688-4eec-ade0-87879e8faaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd9a787-e688-4eec-ade0-87879e8faaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea02424-9249-4eff-a758-d4ace29e6451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:04 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Volume 80e50c52-755a-42ee-b76d-d7284e2eaf10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e50c52-755a-42ee-b76d-d7284e2eaf10', 'volume_size': 1} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3aa0f5e8-5885-4049-8975-cd10642e7c75,created_at=2026-04-17T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375207775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aa0f5e8-5885-4049-8975-cd10642e7c75,host='devstack@QuobyteHD#QuobyteHD',id=80e50c52-755a-42ee-b76d-d7284e2eaf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6f27cdb2d437db0bb04edc05c15e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:04Z,use_quota=True,user_id='74de7156a69548aa8feb6a5e33bc5b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d581e0-9116-4e03-af8e-f3dbe619f809),volume_type_id=d8d581e0-9116-4e03-af8e-f3dbe619f809)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Creating volume 80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:20:04 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:04 devstack sudo[84152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 1073741824 Apr 17 16:20:04 devstack sudo[84152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:04 devstack sudo[84143]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b5974fc7-1702-4150-a25b-24993ea903c9" returned: 0 in 0.997s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-quobyte-b5974fc7-1702-4150-a25b-24993ea903c9" released by "delete_volume" :: held 1.919s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Created reservations ['61aa06f8-dec5-487f-b4ba-c7911f9d617a', '7d28594a-650a-4867-b241-c8de84038393', 'e7b50caf-1984-4d7a-8c49-222fe79b6bff', '3d4c3a38-8984-4de9-ba33-e5e0b843a3da'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:04 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.788s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:04 devstack sudo[84155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:04 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Deleted volume successfully. Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-adbd31b1-564e-4e19-89e4-2a32eff16b3f tempest-VolumesListAdminTestJSON-1429591139 None] Lock "cinder-01c4430e-5bc6-4f89-a090-67ae9445a3cd-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "cinder-6b48343b-17e8-4de9-85fc-01531af53acb-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-6b48343b-17e8-4de9-85fc-01531af53acb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "cinder-quobyte-6b48343b-17e8-4de9-85fc-01531af53acb" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-quobyte-6b48343b-17e8-4de9-85fc-01531af53acb" acquired by "delete_volume" :: waited 0.030s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192417e-955a-4713-bb78-5fc0faec8448]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:05 devstack sudo[84159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb Apr 17 16:20:05 devstack sudo[84159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:05 devstack sudo[84152]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 1073741824" returned: 0 in 1.100s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:05 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.815s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:05 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:05 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Deleted volume successfully. Apr 17 16:20:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-749624ea-7049-46a7-b2a1-181118cda712 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-b5974fc7-1702-4150-a25b-24993ea903c9-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:05 devstack sudo[84164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 Apr 17 16:20:05 devstack sudo[84164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:05 devstack sudo[84159]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb" returned: 0 in 0.936s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:05 devstack sudo[84169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb Apr 17 16:20:05 devstack sudo[84169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:06 devstack sudo[84164]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10" returned: 0 in 0.579s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea02424-9249-4eff-a758-d4ace29e6451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e50c52-755a-42ee-b76d-d7284e2eaf10', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4f761-7ab5-46ba-90c2-341f3fb0f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:06 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Volume volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 (80e50c52-755a-42ee-b76d-d7284e2eaf10): created successfully Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4f761-7ab5-46ba-90c2-341f3fb0f97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Flow 'volume_create_manager' (d7231ff7-4e01-4016-8027-128d192bf8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2c56576b-212e-4d91-b3aa-54daf4a0eda8 tempest-GroupSnapshotsTest-717543183 None] Created volume successfully. Apr 17 16:20:06 devstack sudo[84169]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6b48343b-17e8-4de9-85fc-01531af53acb" returned: 0 in 0.542s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-quobyte-6b48343b-17e8-4de9-85fc-01531af53acb" released by "delete_volume" :: held 1.540s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Created reservations ['b3a1c761-7096-4006-9030-492186ba37d3', '85ed735e-c2e2-4226-8562-88da3ddd3f64', '103d632d-9497-498c-bf6c-99a3f939c5f1', 'bd80c5b9-6385-483a-91be-0c882411bab1'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:06 devstack sudo[84173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:06 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] GroupSnapshot 69b9ae65-af51-447b-8c57-6e80bcf54114: creating. Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Group snapshot 69b9ae65-af51-447b-8c57-6e80bcf54114: creating. {{(pid=82061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Creating offline snapshot 73bc780f-8c64-446f-8198-2392990a6b6b of volume 80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be487ab-76ea-4e08-9a1a-3eac7adcd058]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "cinder-50081372-bcd6-4e53-afe2-a9beda422073-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-50081372-bcd6-4e53-afe2-a9beda422073-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "cinder-quobyte-50081372-bcd6-4e53-afe2-a9beda422073" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-quobyte-50081372-bcd6-4e53-afe2-a9beda422073" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:07 devstack sudo[84176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 Apr 17 16:20:07 devstack sudo[84176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[068e585a-7d13-4089-8e4e-2229ca99527f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:07 devstack sudo[84178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 Apr 17 16:20:07 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:07 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 1.428s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:07 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Deleted volume successfully. Apr 17 16:20:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1597c6ff-d438-4fde-9e84-9041901703c3 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-6b48343b-17e8-4de9-85fc-01531af53acb-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:08 devstack sudo[84176]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10" returned: 0 in 1.114s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:08 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b 1G Apr 17 16:20:08 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:08 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073" returned: 0 in 1.029s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:08 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073 Apr 17 16:20:08 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:08 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b 1G" returned: 0 in 0.679s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:08 devstack sudo[84242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b Apr 17 16:20:08 devstack sudo[84242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:09 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-50081372-bcd6-4e53-afe2-a9beda422073" returned: 0 in 0.816s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-quobyte-50081372-bcd6-4e53-afe2-a9beda422073" released by "delete_volume" :: held 1.919s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Created reservations ['1bba4254-0269-4ec4-8f96-e5a709b9c544', 'a35c165a-9f9c-49d9-b8b6-eece5878cbf8', '1425723e-aca3-41a9-804c-1fd494e9080f', '915d7fc1-457e-451c-9a77-fae1fb79459b'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:09 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:09 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:09 devstack sudo[84242]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b" returned: 0 in 0.497s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:09 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:09 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b Apr 17 16:20:09 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:09 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.598s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:09 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Deleted volume successfully. Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b" returned: 0 in 0.515s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e04b5849-eddb-4ed0-8085-63d3faebb627 tempest-VolumesListAdminTestJSON-1552451995 None] Lock "cinder-50081372-bcd6-4e53-afe2-a9beda422073-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:09 devstack sudo[84258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.info Apr 17 16:20:09 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:10 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.info" returned: 0 in 0.697s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:10 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:20:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:10 devstack sudo[84263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.info Apr 17 16:20:10 devstack sudo[84263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:11 devstack sudo[84263]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.info" returned: 0 in 0.592s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-e7c1b85a-7834-41ae-84f4-54f4e02382f2 req-8820db0f-108a-45a8-9f4c-013abdf988b4 tempest-DeleteServersTestJSON-1660981344 None] Terminate volume connection completed successfully. Apr 17 16:20:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-e7c1b85a-7834-41ae-84f4-54f4e02382f2 req-8820db0f-108a-45a8-9f4c-013abdf988b4 tempest-DeleteServersTestJSON-1660981344 None] Deleting attachment 931a729d-7df6-49aa-8142-8ee9b27db30e. {{(pid=82061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 17 16:20:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-53ce8850-abdc-44c9-a849-5a4996b8de06 tempest-GroupSnapshotsTest-717543183 None] group_snapshot 69b9ae65-af51-447b-8c57-6e80bcf54114: created successfully Apr 17 16:20:12 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] group_snapshot 69b9ae65-af51-447b-8c57-6e80bcf54114: deleting Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] group_snapshot 69b9ae65-af51-447b-8c57-6e80bcf54114: deleting {{(pid=82061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-80e50c52-755a-42ee-b76d-d7284e2eaf10" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-80e50c52-755a-42ee-b76d-d7284e2eaf10" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-73bc780f-8c64-446f-8198-2392990a6b6b" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-73bc780f-8c64-446f-8198-2392990a6b6b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Deleting offline snapshot 73bc780f-8c64-446f-8198-2392990a6b6b of volume 80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] snapshot_file for this snap is: volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[60806e13-b22e-45eb-bff8-6df9323b70b6]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:12 devstack sudo[84292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b Apr 17 16:20:12 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:13 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80e50c52-755a-42ee-b76d-d7284e2eaf10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:20:13 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cfc1bb-82be-48e1-bcf7-03fb98224a2e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:13 devstack sudo[84297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 Apr 17 16:20:13 devstack sudo[84297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:13 devstack sudo[84297]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10" returned: 0 in 0.697s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:13 devstack sudo[84302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b Apr 17 16:20:13 devstack sudo[84302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Flow 'volume_create_manager' (b8028425-837f-4c5f-9882-8a0bb1d63f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6487201a-82ca-4ebe-9ad4-f41af153db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6487201a-82ca-4ebe-9ad4-f41af153db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-560465892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f891913e-ec31-4664-b049-91bf2681327e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab8ee2a287a4b158b7efdac89527d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:14Z,use_quota=True,user_id='23171907e0e543b2a9be2ca5732e6684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a225ff-2e76-4d92-90a3-c67f46937e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a225ff-2e76-4d92-90a3-c67f46937e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8e1a49-ebd0-4448-b61c-5f47ca02b036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8e1a49-ebd0-4448-b61c-5f47ca02b036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f891913e-ec31-4664-b049-91bf2681327e', 'volume_name': 'volume-f891913e-ec31-4664-b049-91bf2681327e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c66fcbe-f33a-4137-b02e-c187589af027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c66fcbe-f33a-4137-b02e-c187589af027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6c85da-f223-4b53-a85d-2f40dd3dfb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:14 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Volume f891913e-ec31-4664-b049-91bf2681327e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f891913e-ec31-4664-b049-91bf2681327e', 'volume_size': 1} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-560465892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f891913e-ec31-4664-b049-91bf2681327e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab8ee2a287a4b158b7efdac89527d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:14Z,use_quota=True,user_id='23171907e0e543b2a9be2ca5732e6684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Creating volume f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:20:14 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:14 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e 1073741824 Apr 17 16:20:14 devstack sudo[84302]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:14 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b" returned: 0 in 0.762s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:14 devstack sudo[84309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b Apr 17 16:20:14 devstack sudo[84309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Acquiring lock "cinder-0c139bae-f6ac-4c82-8b3c-6572c665c9d5-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Lock "cinder-0c139bae-f6ac-4c82-8b3c-6572c665c9d5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Acquiring lock "cinder-quobyte-0c139bae-f6ac-4c82-8b3c-6572c665c9d5" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Lock "cinder-quobyte-0c139bae-f6ac-4c82-8b3c-6572c665c9d5" acquired by "delete_volume" :: waited 0.020s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1122d066-76c7-4d42-ac52-b9d6523a1789]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:15 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 Apr 17 16:20:15 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:15 devstack sudo[84309]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10.73bc780f-8c64-446f-8198-2392990a6b6b" returned: 0 in 0.724s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-73bc780f-8c64-446f-8198-2392990a6b6b" released by "_delete_snapshot" :: held 2.842s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-80e50c52-755a-42ee-b76d-d7284e2eaf10" released by "delete_snapshot" :: held 2.857s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:15 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e 1073741824" returned: 0 in 0.779s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:15 devstack cinder-volume[82061]: WARNING cinder.quota [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1370926748 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1370926748, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:20:15 devstack cinder-volume[82061]: WARNING cinder.quota [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1370926748 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1370926748, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['8dbef8e2-8fae-421b-8a5c-27aff387a789', '6ca8c2d6-100d-4a09-9bfc-8889e1c0c879', 'aae33288-92dd-4f4b-aeb5-0e0ce3cb15ae', '6b838505-dcf1-4ac8-b458-1beda953f72a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:15 devstack sudo[84317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e Apr 17 16:20:15 devstack sudo[84317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:15 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4f35e0c5-c24e-4709-b7c3-f8372e8f3e27 tempest-GroupSnapshotsTest-717543183 None] group_snapshot 69b9ae65-af51-447b-8c57-6e80bcf54114: deleted successfully Apr 17 16:20:15 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5" returned: 0 in 0.679s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:15 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5 Apr 17 16:20:15 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "cinder-quobyte-80e50c52-755a-42ee-b76d-d7284e2eaf10" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:16 devstack sudo[84317]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e" returned: 0 in 0.662s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6c85da-f223-4b53-a85d-2f40dd3dfb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f891913e-ec31-4664-b049-91bf2681327e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe853e75-e663-41c0-9834-9525b3f4aa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-80e50c52-755a-42ee-b76d-d7284e2eaf10" acquired by "delete_volume" :: waited 0.085s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:16 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Volume volume-f891913e-ec31-4664-b049-91bf2681327e (f891913e-ec31-4664-b049-91bf2681327e): created successfully Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe853e75-e663-41c0-9834-9525b3f4aa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Flow 'volume_create_manager' (b8028425-837f-4c5f-9882-8a0bb1d63f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b72f151-10a8-42bd-8761-2e380dea301e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-333f989f-7812-43e0-973a-37836dbff66e tempest-SnapshotMetadataTestJSON-2060852920 None] Created volume successfully. Apr 17 16:20:16 devstack sudo[84329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 Apr 17 16:20:16 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:16 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0c139bae-f6ac-4c82-8b3c-6572c665c9d5" returned: 0 in 0.695s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Lock "cinder-quobyte-0c139bae-f6ac-4c82-8b3c-6572c665c9d5" released by "delete_volume" :: held 1.401s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Created reservations ['0c397f3e-d799-4d38-a47e-22977fec888a', '2cdbf794-b9c6-4f7a-8fac-309f7f954358', '29cd1c77-84b6-4cb4-a169-ef9f62df04ba', 'e281be26-8fdb-434f-81a6-921992450f38'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:16 devstack sudo[84334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:16 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:16 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10" returned: 0 in 0.570s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:16 devstack sudo[84339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10 Apr 17 16:20:16 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Creating offline snapshot b8237a93-ca0a-4317-bf03-cd0b5630c725 of volume f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0055ce97-5104-405c-b7b0-04c6266919dd]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:16 devstack sudo[84341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e Apr 17 16:20:16 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:16 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:16 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Deleted volume successfully. Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1d5a8124-8191-49ab-9836-2504bb754295 tempest-DeleteServersTestJSON-1660981344 None] Lock "cinder-0c139bae-f6ac-4c82-8b3c-6572c665c9d5-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:17 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e" returned: 0 in 0.571s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:17 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-80e50c52-755a-42ee-b76d-d7284e2eaf10" returned: 0 in 0.634s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Lock "cinder-quobyte-80e50c52-755a-42ee-b76d-d7284e2eaf10" released by "delete_volume" :: held 1.251s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:17 devstack sudo[84348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 1G Apr 17 16:20:17 devstack sudo[84348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['17001b61-1b0c-459b-af1f-85ac3185cdad'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:17 devstack cinder-volume[82061]: WARNING cinder.quota [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1370926748 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1370926748, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Created reservations ['fd21127e-3a57-47c8-9dea-061a5fc5e21e', 'd2891332-be29-43fb-9676-56d97814139a', '77e8cbd0-52c2-4924-9170-9d32a376a7f3', '5c07325a-0e67-4434-a7cc-006c1473d930'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:17 devstack sudo[84350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:17 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:17 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.453s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-02f783f2-a75a-4734-a192-71aae26779b2 tempest-GroupSnapshotsTest-717543183 None] Delete group completed successfully. Apr 17 16:20:17 devstack sudo[84348]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 1G" returned: 0 in 0.694s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f891913e-ec31-4664-b049-91bf2681327e -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:18 devstack sudo[84356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f891913e-ec31-4664-b049-91bf2681327e -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 Apr 17 16:20:18 devstack sudo[84356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:18 devstack sudo[84356]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f891913e-ec31-4664-b049-91bf2681327e -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725" returned: 0 in 0.658s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:18 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 is being set with open permissions: ugo+rw Apr 17 16:20:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:18 devstack sudo[84362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 Apr 17 16:20:18 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:19 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725" returned: 0 in 0.608s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:19 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.info Apr 17 16:20:19 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:19 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.info" returned: 0 in 0.601s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:19 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.info is being set with open permissions: ugo+rw Apr 17 16:20:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:19 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.info Apr 17 16:20:19 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:20 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.info" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.751s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:20 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3d09044d-2dda-408f-abd0-8158bab3bd5f tempest-SnapshotMetadataTestJSON-2060852920 None] Create snapshot completed successfully Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "cinder-b8237a93-ca0a-4317-bf03-cd0b5630c725-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-b8237a93-ca0a-4317-bf03-cd0b5630c725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "cinder-quobyte-f891913e-ec31-4664-b049-91bf2681327e" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-quobyte-f891913e-ec31-4664-b049-91bf2681327e" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "cinder-quobyte-b8237a93-ca0a-4317-bf03-cd0b5630c725" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-quobyte-b8237a93-ca0a-4317-bf03-cd0b5630c725" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Deleting offline snapshot b8237a93-ca0a-4317-bf03-cd0b5630c725 of volume f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] snapshot_file for this snap is: volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5513d935-2314-47bc-81e8-f5c3117c5b5f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:21 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 Apr 17 16:20:21 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:22 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725" returned: 0 in 0.996s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f891913e-ec31-4664-b049-91bf2681327e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c590a-fd67-483b-822e-9ef567bb8820]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:22 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e Apr 17 16:20:22 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Flow 'volume_create_manager' (8d42bdac-466d-4252-bb8f-d2e2c79cc596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7260fe-a928-4ff4-b8c1-7a7e48063ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7260fe-a928-4ff4-b8c1-7a7e48063ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98823a8-9293-4587-9498-b1fbaa451546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de01b8352384035be0182adeed4a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:23Z,use_quota=True,user_id='7a868d3aa71d4947aca51db91774d006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f0810b-0e02-4472-bfb9-d8a91812f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f0810b-0e02-4472-bfb9-d8a91812f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293b39ff-e65a-44b8-a4f9-4ddc1589b33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:22 devstack cinder-volume[82061]: DEBUG cinder.image.glance [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Creating Keystone auth plugin from conf {{(pid=82061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 16:20:23 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e" returned: 0 in 0.758s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:23 devstack sudo[84388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 Apr 17 16:20:23 devstack sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293b39ff-e65a-44b8-a4f9-4ddc1589b33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e98823a8-9293-4587-9498-b1fbaa451546', 'volume_name': 'volume-e98823a8-9293-4587-9498-b1fbaa451546', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a286b63-2f0a-4f64-8054-d5af4191b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a286b63-2f0a-4f64-8054-d5af4191b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a00d77-474f-45d0-8ec5-bc0665ff028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:23 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Volume e98823a8-9293-4587-9498-b1fbaa451546: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e98823a8-9293-4587-9498-b1fbaa451546', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 16:20:23 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Trying to clone e98823a8-9293-4587-9498-b1fbaa451546 from image 35106061-d1fb-4b07-851b-6be93771408f at location (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]). {{(pid=82061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 16:20:24 devstack cinder-volume[82061]: INFO cinder.image.image_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Image download 20.69 MB at 20.69 MB/s Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d24e7a-b409-46e9-aa5b-f2b5703eb9ad]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:24 devstack sudo[84388]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725" returned: 0 in 0.615s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:24 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725 Apr 17 16:20:24 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:24 devstack sudo[84415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD Apr 17 16:20:24 devstack sudo[84415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:24 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e.b8237a93-ca0a-4317-bf03-cd0b5630c725" returned: 0 in 0.526s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-quobyte-b8237a93-ca0a-4317-bf03-cd0b5630c725" released by "_delete_snapshot" :: held 2.974s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-quobyte-f891913e-ec31-4664-b049-91bf2681327e" released by "delete_snapshot" :: held 3.004s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Created reservations ['51b020ff-3f87-4482-a8dc-aa52e21dc93c', '6bb56215-d294-4be4-b024-cedbcf3c7aaa', 'a1bf9638-473c-4a1b-aff6-6ea2e245fead', '40653cc8-39f9-42f3-a5a8-b9516a8651c8'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:24 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Delete snapshot completed successfully. Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36bfee15-f140-49d3-911b-e9974933a6e0 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-b8237a93-ca0a-4317-bf03-cd0b5630c725-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:24 devstack sudo[84415]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:24 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f is fetched for user 7a868d3aa71d4947aca51db91774d006. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d267a5-6403-405f-b7bd-4948adf9ea19]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "cinder-f891913e-ec31-4664-b049-91bf2681327e-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-f891913e-ec31-4664-b049-91bf2681327e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:25 devstack sudo[84423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD Apr 17 16:20:25 devstack sudo[84423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "cinder-quobyte-f891913e-ec31-4664-b049-91bf2681327e" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-quobyte-f891913e-ec31-4664-b049-91bf2681327e" acquired by "delete_volume" :: waited 0.019s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a78fc-108c-4b19-b825-584448cb18d5]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:25 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e Apr 17 16:20:25 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:25 devstack sudo[84423]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98823a8-9293-4587-9498-b1fbaa451546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de01b8352384035be0182adeed4a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:23Z,use_quota=True,user_id='7a868d3aa71d4947aca51db91774d006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Creating volume e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:20:25 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:20:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:25 devstack sudo[84430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 1073741824 Apr 17 16:20:25 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:26 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e" returned: 0 in 0.944s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:26 devstack sudo[84439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e Apr 17 16:20:26 devstack sudo[84439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:26 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 1073741824" returned: 0 in 0.653s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:26 devstack sudo[84441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:20:26 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:26 devstack sudo[84439]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f891913e-ec31-4664-b049-91bf2681327e" returned: 0 in 0.509s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-quobyte-f891913e-ec31-4664-b049-91bf2681327e" released by "delete_volume" :: held 1.500s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Created reservations ['f347bf96-6f7b-40bf-a039-2f39f7d5d373', '5fb56431-c14e-4bf1-b505-55450abc6fca', 'bd0577c5-4c38-4187-a960-dbd553a624b1', '659fe3a4-4db4-48fd-88ad-85b3f4a7ac3e'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:26 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 0 in 0.484s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:26 devstack sudo[84445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:26 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Attempting download of 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume e98823a8-9293-4587-9498-b1fbaa451546. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b115722e-04c5-42d8-8a64-e93f5a9fbdd5]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_gf09_fyt {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:27 devstack sudo[84449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_gf09_fyt Apr 17 16:20:27 devstack sudo[84449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:27 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.520s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:27 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:27 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Deleted volume successfully. Apr 17 16:20:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4ff7080b-b54d-4949-981c-264009c472e8 tempest-SnapshotMetadataTestJSON-2060852920 None] Lock "cinder-f891913e-ec31-4664-b049-91bf2681327e-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:28 devstack sudo[84449]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_gf09_fyt" returned: 0 in 1.273s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_gf09_fyt {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:28 devstack sudo[84458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_gf09_fyt Apr 17 16:20:28 devstack sudo[84458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:28 devstack sudo[84458]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_gf09_fyt" returned: 1 in 0.620s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_gf09_fyt' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:20:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98d524-2f70-4f6c-9f3a-d4dffccf9d3e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:28 devstack sudo[84468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD Apr 17 16:20:28 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:29 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:29 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] 35106061-d1fb-4b07-851b-6be93771408f was qcow2, converting to raw {{(pid=82061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 16:20:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:29 devstack sudo[84473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:20:29 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:31 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 0 in 1.555s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:31 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_o9u83osndevstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:20:31 devstack cinder-volume[82061]: INFO cinder.image.image_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Converted 112.00 MB image at 71.94 MB/s Apr 17 16:20:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:31 devstack sudo[84490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 1G Apr 17 16:20:31 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:31 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 1G" returned: 0 in 0.757s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:31 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32989cf-2e8a-4750-bcde-490d638f40ef]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:32 devstack sudo[84496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:20:32 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:32 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 0 in 0.728s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:32 devstack sudo[84500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:20:32 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:33 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 1 in 0.918s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Downloaded image 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume e98823a8-9293-4587-9498-b1fbaa451546 successfully. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f for user 7a868d3aa71d4947aca51db91774d006 is deleted. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Marking volume e98823a8-9293-4587-9498-b1fbaa451546 as bootable. {{(pid=82061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Copying metadata from image 35106061-d1fb-4b07-851b-6be93771408f to e98823a8-9293-4587-9498-b1fbaa451546. {{(pid=82061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Creating volume glance metadata for volume e98823a8-9293-4587-9498-b1fbaa451546 backed by image 35106061-d1fb-4b07-851b-6be93771408f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a00d77-474f-45d0-8ec5-bc0665ff028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98823a8-9293-4587-9498-b1fbaa451546', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d111bcaf-d52b-4df9-a7a3-99fd746c2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Volume volume-e98823a8-9293-4587-9498-b1fbaa451546 (e98823a8-9293-4587-9498-b1fbaa451546): created successfully Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d111bcaf-d52b-4df9-a7a3-99fd746c2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Flow 'volume_create_manager' (8d42bdac-466d-4252-bb8f-d2e2c79cc596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-cfa84ab3-008c-48ba-905f-de9b53066602 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Created volume successfully. Apr 17 16:20:33 devstack sudo[84505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:33 devstack sudo[84505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:34 devstack sudo[84505]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.850s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:35 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcd40f6-eb04-4f98-86a5-d280b6a3290a]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:35 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:20:35 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:36 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 0 in 0.858s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:36 devstack sudo[84532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:20:36 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:37 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 1 in 0.798s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:20:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.727s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4', 'name': 'volume-e98823a8-9293-4587-9498-b1fbaa451546', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4940fc0-377b-4ca2-991d-c30612ac1e79', 'enforce_multipath': True} {{(pid=82061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 17 16:20:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-3cf16dec-8fb8-4d63-85ab-de4ee3c7225c req-24366fc3-4918-40fe-8f36-25bf9fbbc94b tempest-ServerBootFromVolumeStableRescueTest-802258104 None] attachment_update completed successfully. Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Flow 'volume_create_manager' (81a7601c-053d-4efb-845a-554c0bf6fc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34613b72-1a2a-4a86-b8d1-89b2be2debb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34613b72-1a2a-4a86-b8d1-89b2be2debb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1565948367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711df644-ab46-4638-9615-f1846deccfc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22585051834a46419151c63ceab83d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:42Z,use_quota=True,user_id='34195871061c4c6f85c0ce64b7702fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f71e002-26f2-4b65-98af-23723880e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f71e002-26f2-4b65-98af-23723880e41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b71c20e-6e4a-48d5-a4e4-6cc19f2f4731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b71c20e-6e4a-48d5-a4e4-6cc19f2f4731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711df644-ab46-4638-9615-f1846deccfc9', 'volume_name': 'volume-711df644-ab46-4638-9615-f1846deccfc9', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655b2a73-8c0c-4f16-8191-f084709f6fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655b2a73-8c0c-4f16-8191-f084709f6fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4452d4-3f0f-460b-a2fb-3f07971b92d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:41 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Volume 711df644-ab46-4638-9615-f1846deccfc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711df644-ab46-4638-9615-f1846deccfc9', 'volume_size': 1} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1565948367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711df644-ab46-4638-9615-f1846deccfc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22585051834a46419151c63ceab83d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:42Z,use_quota=True,user_id='34195871061c4c6f85c0ce64b7702fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Creating volume 711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:20:41 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:20:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:41 devstack sudo[84574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 1073741824 Apr 17 16:20:41 devstack sudo[84574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:42 devstack sudo[84574]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 1073741824" returned: 0 in 0.963s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:20:42 devstack sudo[84587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 Apr 17 16:20:42 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Flow 'volume_create_manager' (72b75147-3b2c-4cac-824c-81bd33ce609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558c1894-4c03-4cec-af3c-7b704c6ee16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558c1894-4c03-4cec-af3c-7b704c6ee16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644218701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577dafb9-c1cc-4172-ae36-0e2cd8dd07e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d658097d83f48f79c2aca9a5d9ecf48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:43Z,use_quota=True,user_id='b9c7e520c8ca42808e23d6457abd09d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c8acd9-ea8a-4600-ae1a-511dc55f1e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c8acd9-ea8a-4600-ae1a-511dc55f1e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8764eb3c-a78e-4fe6-ba82-47d37f568780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8764eb3c-a78e-4fe6-ba82-47d37f568780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577dafb9-c1cc-4172-ae36-0e2cd8dd07e4', 'volume_name': 'volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01b1be-1828-490b-b608-c6a0434b81a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01b1be-1828-490b-b608-c6a0434b81a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863b6278-46bc-4971-9148-b925a9e6ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:42 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Volume 577dafb9-c1cc-4172-ae36-0e2cd8dd07e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4', 'volume_size': 1} Apr 17 16:20:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:43 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9" returned: 0 in 0.517s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644218701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577dafb9-c1cc-4172-ae36-0e2cd8dd07e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d658097d83f48f79c2aca9a5d9ecf48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:20:43Z,use_quota=True,user_id='b9c7e520c8ca42808e23d6457abd09d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Creating volume 577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:20:43 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4452d4-3f0f-460b-a2fb-3f07971b92d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711df644-ab46-4638-9615-f1846deccfc9', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6d088e-9338-429e-bc72-10899f83fbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:43 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 1073741824 Apr 17 16:20:43 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:43 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Volume volume-711df644-ab46-4638-9615-f1846deccfc9 (711df644-ab46-4638-9615-f1846deccfc9): created successfully Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6d088e-9338-429e-bc72-10899f83fbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Flow 'volume_create_manager' (81a7601c-053d-4efb-845a-554c0bf6fc37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:43 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7ebe1aba-0654-4bb7-90c9-b552658e81ea tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Created volume successfully. Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:44 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 1073741824" returned: 0 in 0.750s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:44 devstack sudo[84612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:20:44 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:44 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.543s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.571s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Creating offline snapshot 44750fb1-26cb-4e39-8665-3e8a6bbac8e2 of volume 711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863b6278-46bc-4971-9148-b925a9e6ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d752c1-c228-44fa-a38c-7d0276c39118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c46796-28bf-4b35-ad0e-0ffb06969768]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:44 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Volume volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 (577dafb9-c1cc-4172-ae36-0e2cd8dd07e4): created successfully Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d752c1-c228-44fa-a38c-7d0276c39118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:20:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Flow 'volume_create_manager' (72b75147-3b2c-4cac-824c-81bd33ce609c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:20:44 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-716c888e-0c5c-4b86-89dd-354287d9e040 tempest-VolumesActionsTest-1927412870 None] Created volume successfully. Apr 17 16:20:44 devstack sudo[84617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 Apr 17 16:20:44 devstack sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:45 devstack sudo[84617]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9" returned: 0 in 0.600s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:45 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 1G Apr 17 16:20:45 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:45 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 1G" returned: 0 in 0.541s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711df644-ab46-4638-9615-f1846deccfc9 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:45 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711df644-ab46-4638-9615-f1846deccfc9 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 Apr 17 16:20:45 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:46 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711df644-ab46-4638-9615-f1846deccfc9 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2" returned: 0 in 0.500s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:46 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 is being set with open permissions: ugo+rw Apr 17 16:20:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:46 devstack sudo[84637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 Apr 17 16:20:46 devstack sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:46 devstack sudo[84637]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2" returned: 0 in 0.454s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:46 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.info Apr 17 16:20:46 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:47 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.info" returned: 0 in 0.490s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:47 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.info is being set with open permissions: ugo+rw Apr 17 16:20:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:47 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.info Apr 17 16:20:47 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:47 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.info" returned: 0 in 0.453s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:47 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4aae30e0-11bd-434d-b2d8-6627c73be366 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Create snapshot completed successfully Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "cinder-44750fb1-26cb-4e39-8665-3e8a6bbac8e2-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-44750fb1-26cb-4e39-8665-3e8a6bbac8e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "cinder-quobyte-711df644-ab46-4638-9615-f1846deccfc9" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-quobyte-711df644-ab46-4638-9615-f1846deccfc9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "cinder-quobyte-44750fb1-26cb-4e39-8665-3e8a6bbac8e2" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-quobyte-44750fb1-26cb-4e39-8665-3e8a6bbac8e2" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Deleting offline snapshot 44750fb1-26cb-4e39-8665-3e8a6bbac8e2 of volume 711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] snapshot_file for this snap is: volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf781ea-1fd8-4e37-8691-0147a32ccaef]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:49 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 Apr 17 16:20:49 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:51 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2" returned: 0 in 1.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-711df644-ab46-4638-9615-f1846deccfc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:20:51 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35fc5a9-0e8f-4548-9990-ccbe9da6a5e3]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:51 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 Apr 17 16:20:51 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:51 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9" returned: 0 in 0.876s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:52 devstack sudo[84741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 Apr 17 16:20:52 devstack sudo[84741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:53 devstack sudo[84741]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2" returned: 0 in 1.856s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:53 devstack sudo[84764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2 Apr 17 16:20:53 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:54 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9.44750fb1-26cb-4e39-8665-3e8a6bbac8e2" returned: 0 in 1.009s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:54 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=132,cinder:INSERT=44,cinder:UPDATE=117,cinder:DELETE=5 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:20:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-quobyte-44750fb1-26cb-4e39-8665-3e8a6bbac8e2" released by "_delete_snapshot" :: held 5.441s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-quobyte-711df644-ab46-4638-9615-f1846deccfc9" released by "delete_snapshot" :: held 5.483s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:54 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Created reservations ['2a423231-2905-4c5e-80a9-80f3a462762d', 'a87414f3-0f4c-4308-be1f-293f99818852', '6e81368f-ac38-4aac-a066-fcdc5db4e3be', 'b7b525f8-84be-4e47-9f66-6e08aa00db9c'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Delete snapshot completed successfully. Apr 17 16:20:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b849ec5-ac5a-4f0c-adf0-a9787f4ffcaf tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-44750fb1-26cb-4e39-8665-3e8a6bbac8e2-delete_snapshot" released by "delete_snapshot" :: held 5.611s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "cinder-711df644-ab46-4638-9615-f1846deccfc9-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-711df644-ab46-4638-9615-f1846deccfc9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:UPDATE=170,cinder:SELECT=128,cinder:DELETE=12,cinder:INSERT=37 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "cinder-quobyte-711df644-ab46-4638-9615-f1846deccfc9" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-quobyte-711df644-ab46-4638-9615-f1846deccfc9" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[942e935d-6bc6-4107-867f-ba13070164d2]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:56 devstack sudo[84770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 Apr 17 16:20:56 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:56 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9" returned: 0 in 0.682s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:56 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9 Apr 17 16:20:56 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:58 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-711df644-ab46-4638-9615-f1846deccfc9" returned: 0 in 1.179s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-quobyte-711df644-ab46-4638-9615-f1846deccfc9" released by "delete_volume" :: held 1.954s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Created reservations ['600a84b4-a6b6-4a18-b5b0-bfdb5fa040e1', 'e5774d36-6a1a-4983-b4b6-5578f2554433', 'cd475ca6-6b1e-440b-be76-c6fdd337d31e', '401c2eb3-6330-407a-85f7-184f7ac62701'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:20:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:20:58 devstack sudo[84840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:20:58 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:20:59 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root Apr 17 16:20:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.948s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:20:59 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:20:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Deleted volume successfully. Apr 17 16:20:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-febff99d-3bd8-44d5-9df8-ebab6057c6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-866180820 None] Lock "cinder-711df644-ab46-4638-9615-f1846deccfc9-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-27ffa067-736c-4f9e-ae06-73fa789015a6 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" by "attach_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-27ffa067-736c-4f9e-ae06-73fa789015a6 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" acquired by "attach_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-27ffa067-736c-4f9e-ae06-73fa789015a6 tempest-VolumesActionsTest-1927412870 None] Attaching volume 577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 to instance dd19e529-af33-41a2-9de1-e51a1b362722 at mountpoint /dev/vdb on host None. Apr 17 16:21:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-27ffa067-736c-4f9e-ae06-73fa789015a6 tempest-VolumesActionsTest-1927412870 None] Attach volume completed successfully. Apr 17 16:21:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-27ffa067-736c-4f9e-ae06-73fa789015a6 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" released by "attach_volume" :: held 0.110s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdee1a63-3fb9-4aab-bb0d-c5680790be98 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-detach_volume" by "detach_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdee1a63-3fb9-4aab-bb0d-c5680790be98 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fdee1a63-3fb9-4aab-bb0d-c5680790be98 tempest-VolumesActionsTest-1927412870 None] Detaching volume 577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 from instance dd19e529-af33-41a2-9de1-e51a1b362722. Apr 17 16:21:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fdee1a63-3fb9-4aab-bb0d-c5680790be98 tempest-VolumesActionsTest-1927412870 None] Detach volume completed successfully. Apr 17 16:21:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdee1a63-3fb9-4aab-bb0d-c5680790be98 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Flow 'volume_create_manager' (7ea5aa29-76c8-453a-9be1-c1d168b0df62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ddc4a5-198a-4a64-8ca3-d8ed864278a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ddc4a5-198a-4a64-8ca3-d8ed864278a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1214814100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34413e32-51e7-4293-832a-797d159218bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9927c9c5dc343ebad8a45dc0276f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:06Z,use_quota=True,user_id='b52db6e906904272a46788c59a40fa06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d92ee891-5642-407f-84ee-0145a15550bf),volume_type_id=d92ee891-5642-407f-84ee-0145a15550bf)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d509dbc-2e7a-4aba-948a-73f64507127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d509dbc-2e7a-4aba-948a-73f64507127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee645c4b-1b6e-4aa5-babe-fefeffb0199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee645c4b-1b6e-4aa5-babe-fefeffb0199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34413e32-51e7-4293-832a-797d159218bb', 'volume_name': 'volume-34413e32-51e7-4293-832a-797d159218bb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c704fe-6a6e-43bd-9582-abd770fa2b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c704fe-6a6e-43bd-9582-abd770fa2b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e12ad7-8e5a-4573-928e-16860e120dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:06 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Volume 34413e32-51e7-4293-832a-797d159218bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34413e32-51e7-4293-832a-797d159218bb', 'volume_size': 1} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1214814100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34413e32-51e7-4293-832a-797d159218bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9927c9c5dc343ebad8a45dc0276f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:06Z,use_quota=True,user_id='b52db6e906904272a46788c59a40fa06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d92ee891-5642-407f-84ee-0145a15550bf),volume_type_id=d92ee891-5642-407f-84ee-0145a15550bf)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Creating volume 34413e32-51e7-4293-832a-797d159218bb {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:21:06 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:21:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:06 devstack sudo[85062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb 1073741824 Apr 17 16:21:06 devstack sudo[85062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:08 devstack sudo[85062]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb 1073741824" returned: 0 in 1.709s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:08 devstack sudo[85075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb Apr 17 16:21:08 devstack sudo[85075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Flow 'volume_create_manager' (d3c44e8e-f809-4a9e-862d-671e4b1f8a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b8b0e-5349-48b9-a056-6768e0465a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:09 devstack sudo[85075]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb" returned: 0 in 1.007s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] <== create_volume: return (2762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.768s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b8b0e-5349-48b9-a056-6768e0465a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1415648369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248a5e4951114210a856909aa816b03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:09Z,use_quota=True,user_id='7791f8d0a86746c399acc3ef85077959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff6fb90-e448-4731-8780-061d13084f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff6fb90-e448-4731-8780-061d13084f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8380a527-bd53-41ea-b3bf-c0e4695bef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8380a527-bd53-41ea-b3bf-c0e4695bef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0', 'volume_name': 'volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5c0b76-146e-43a6-bd2c-eb2de7e11fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5c0b76-146e-43a6-bd2c-eb2de7e11fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7c9521-ac68-40b3-8e00-58ad98d3df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:09 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Volume f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0', 'volume_size': 1} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1415648369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248a5e4951114210a856909aa816b03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:09Z,use_quota=True,user_id='7791f8d0a86746c399acc3ef85077959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Creating volume f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:21:09 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:09 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 1073741824 Apr 17 16:21:09 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e12ad7-8e5a-4573-928e-16860e120dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34413e32-51e7-4293-832a-797d159218bb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d890ead-14b1-4566-8e81-98fc20b478d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:09 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Volume volume-34413e32-51e7-4293-832a-797d159218bb (34413e32-51e7-4293-832a-797d159218bb): created successfully Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d890ead-14b1-4566-8e81-98fc20b478d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Flow 'volume_create_manager' (7ea5aa29-76c8-453a-9be1-c1d168b0df62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:21:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7aaefff8-8b9d-420f-bcec-c4a06b4fbdee tempest-VolumeTypesAccessTest-929342839 None] Created volume successfully. Apr 17 16:21:10 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 1073741824" returned: 0 in 0.829s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:10 devstack sudo[85085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 Apr 17 16:21:10 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Acquiring lock "cinder-34413e32-51e7-4293-832a-797d159218bb-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Lock "cinder-34413e32-51e7-4293-832a-797d159218bb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Acquiring lock "cinder-quobyte-34413e32-51e7-4293-832a-797d159218bb" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Lock "cinder-quobyte-34413e32-51e7-4293-832a-797d159218bb" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5fe6b-969d-4160-ab07-5e02c22a8fc2]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:11 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0" returned: 0 in 0.981s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7c9521-ac68-40b3-8e00-58ad98d3df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433f7833-78e8-4ea7-883a-d2c49c081e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:11 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Volume volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 (f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0): created successfully Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433f7833-78e8-4ea7-883a-d2c49c081e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Flow 'volume_create_manager' (d3c44e8e-f809-4a9e-862d-671e4b1f8a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:21:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a49b662a-dde5-45b1-9a5c-15b813919363 tempest-ServerRescueNegativeTestJSON-1437738431 None] Created volume successfully. Apr 17 16:21:11 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb Apr 17 16:21:11 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:12 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb" returned: 0 in 1.040s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:12 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb Apr 17 16:21:12 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:13 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-34413e32-51e7-4293-832a-797d159218bb" returned: 0 in 0.919s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Lock "cinder-quobyte-34413e32-51e7-4293-832a-797d159218bb" released by "delete_volume" :: held 2.011s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:13 devstack cinder-volume[82061]: WARNING cinder.quota [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1683500728 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1683500728, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:21:13 devstack cinder-volume[82061]: WARNING cinder.quota [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1683500728 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1683500728, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Created reservations ['76dfe027-a1ef-40bf-aa5a-3091257bf1cb', 'a7a93aea-3ef3-4c9e-8ec1-d34de70fb418', '0de51885-ad27-4f95-a7c8-2b10ac7682aa', '8937eba8-8ada-432f-a895-de54a19e1295'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:13 devstack sudo[85155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:21:13 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:14 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 1.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:14 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:21:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Deleted volume successfully. Apr 17 16:21:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b43a3d7f-c82b-4d00-b8d6-1594b0314f17 tempest-VolumeTypesAccessTest-929342839 None] Lock "cinder-34413e32-51e7-4293-832a-797d159218bb-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:19 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-b36e6e56-0a05-455d-8c64-0a195f0dd0b8 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Terminate volume connection completed successfully. Apr 17 16:21:19 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-b36e6e56-0a05-455d-8c64-0a195f0dd0b8 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Deleting attachment a4940fc0-377b-4ca2-991d-c30612ac1e79. {{(pid=82061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "cinder-e98823a8-9293-4587-9498-b1fbaa451546-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-e98823a8-9293-4587-9498-b1fbaa451546-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "cinder-quobyte-e98823a8-9293-4587-9498-b1fbaa451546" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-quobyte-e98823a8-9293-4587-9498-b1fbaa451546" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3a6f60-9b68-4fdb-a841-15a58e1eaa80]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:20 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:21:20 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:20 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 0 in 0.644s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:21 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:21:21 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:21 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 1 in 0.765s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:21:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:21 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546 Apr 17 16:21:21 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:22 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e98823a8-9293-4587-9498-b1fbaa451546" returned: 0 in 0.834s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-quobyte-e98823a8-9293-4587-9498-b1fbaa451546" released by "delete_volume" :: held 2.332s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG cinder.quota [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Created reservations ['6a30e8ff-cf39-45b5-b59d-f16acb8ad955', 'a070588e-3490-4ce9-97e2-43106e09cb86', 'dec91f90-7035-4ef6-a078-4f29a66be58f', '542f9732-aceb-441f-95b9-b81d27e007d9'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:22 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:21:22 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:23 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 1.029s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:23 devstack cinder-volume[82061]: DEBUG cinder.manager [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:21:23 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Deleted volume successfully. Apr 17 16:21:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-1b6cd9d6-9a8b-4175-9638-be81df2c4044 req-1a5abd7d-171e-4a48-ac85-5954b52e9a62 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-e98823a8-9293-4587-9498-b1fbaa451546-delete_volume" released by "delete_volume" :: held 3.701s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Acquiring lock "cinder-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "cinder-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Acquiring lock "cinder-quobyte-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "cinder-quobyte-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0" acquired by "delete_volume" :: waited 0.026s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:31 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e366605-5c66-43d9-aee1-fbe7ce2d1672]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:32 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 Apr 17 16:21:32 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:33 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0" returned: 0 in 1.386s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:33 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0 Apr 17 16:21:33 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:33 devstack sudo[85478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:21:33 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:34 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.907s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:21:34 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0" returned: 0 in 1.581s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "cinder-quobyte-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0" released by "delete_volume" :: held 3.045s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:34 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Created reservations ['d1003a99-f14a-4911-9ca4-0796e6983754', 'ab10ccda-78de-48cf-9f7e-23e52f5683ee', '1d971254-f560-446d-a669-744bf74e5189', 'eb37f9eb-eed1-4efb-92cc-785e549af9ca'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:35 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:21:35 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8ad0c8f5-78a5-452d-81fe-faf0637ae306 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" by "attach_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8ad0c8f5-78a5-452d-81fe-faf0637ae306 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" acquired by "attach_volume" :: waited 0.022s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8ad0c8f5-78a5-452d-81fe-faf0637ae306 tempest-VolumesActionsTest-1927412870 None] Attaching volume 577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 to instance 0834a3b3-c071-4dc8-8e15-f8c4471fd4fb at mountpoint /dev/vdb on host None. Apr 17 16:21:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8ad0c8f5-78a5-452d-81fe-faf0637ae306 tempest-VolumesActionsTest-1927412870 None] Attach volume completed successfully. Apr 17 16:21:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8ad0c8f5-78a5-452d-81fe-faf0637ae306 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" released by "attach_volume" :: held 0.185s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:36 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 1.052s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:21:36 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Deleted volume successfully. Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b4e0285-e50a-4f73-95cb-c947e9bd202f tempest-ServerRescueNegativeTestJSON-1437738431 None] Lock "cinder-f1c5cbc0-28e2-4ddd-a7d9-e67e8f5179c0-delete_volume" released by "delete_volume" :: held 4.399s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:36 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-eed4e659-a982-499f-80f8-efb71ec54041 req-3dbf26ce-1049-4319-b350-f57e1686dfce tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Terminate volume connection completed successfully. Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-eed4e659-a982-499f-80f8-efb71ec54041 req-3dbf26ce-1049-4319-b350-f57e1686dfce tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Deleting attachment 11711704-c241-4619-8bc8-bbd5e25551d9. {{(pid=82061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d39a1d7a-f284-41d0-b996-e41de2ebdfc5 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-detach_volume" by "detach_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d39a1d7a-f284-41d0-b996-e41de2ebdfc5 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:36 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d39a1d7a-f284-41d0-b996-e41de2ebdfc5 tempest-VolumesActionsTest-1927412870 None] Detaching volume 577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 from instance 0834a3b3-c071-4dc8-8e15-f8c4471fd4fb. Apr 17 16:21:36 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d39a1d7a-f284-41d0-b996-e41de2ebdfc5 tempest-VolumesActionsTest-1927412870 None] Detach volume completed successfully. Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d39a1d7a-f284-41d0-b996-e41de2ebdfc5 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "cinder-a6ea3867-4710-4414-a812-943c6cbe7581-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-a6ea3867-4710-4414-a812-943c6cbe7581-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "cinder-quobyte-a6ea3867-4710-4414-a812-943c6cbe7581" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-quobyte-a6ea3867-4710-4414-a812-943c6cbe7581" acquired by "delete_volume" :: waited 0.023s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:36 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[56048057-29a2-458e-9507-1b689c6ab5ab]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:37 devstack sudo[85518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 Apr 17 16:21:37 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:38 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581" returned: 0 in 1.355s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:38 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581 Apr 17 16:21:38 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:39 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a6ea3867-4710-4414-a812-943c6cbe7581" returned: 0 in 0.725s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-quobyte-a6ea3867-4710-4414-a812-943c6cbe7581" released by "delete_volume" :: held 2.225s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG cinder.quota [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Created reservations ['db0275af-11a2-42ab-8f82-9f8d95cc5134', '9a25e59d-37c3-43a1-bce3-ecca1bcc6f9a', 'c89c4b0f-0d9b-495c-a96a-55061f471f23', 'a6dac28f-4562-4ae9-bc49-3bcb7e85a19a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:39 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:21:39 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:39 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.599s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG cinder.manager [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:21:39 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Deleted volume successfully. Apr 17 16:21:39 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-eed4e659-a982-499f-80f8-efb71ec54041 req-ec12e3f1-9e2b-4f8f-8f5f-2e5a061107d6 tempest-ServerBootFromVolumeStableRescueTest-802258104 None] Lock "cinder-a6ea3867-4710-4414-a812-943c6cbe7581-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Flow 'volume_create_manager' (203f3288-ee86-4a72-8026-1c5b045cd05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88972f5f-b401-47c9-9191-7f16243b7041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88972f5f-b401-47c9-9191-7f16243b7041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-530522692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35be7bb-b7ce-445b-a1c7-14b9a74a97b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf56e37c3c1405ca84000270976ce66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:43Z,use_quota=True,user_id='d8b984af9a2c482ba362242fed76fd2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7850c4f0-8999-449d-9696-69fd4f6bddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7850c4f0-8999-449d-9696-69fd4f6bddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ac6af-8af7-43e6-a4f9-d40f46a3b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ac6af-8af7-43e6-a4f9-d40f46a3b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35be7bb-b7ce-445b-a1c7-14b9a74a97b2', 'volume_name': 'volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b11725-9812-4a6b-b1b2-818ed026d65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b11725-9812-4a6b-b1b2-818ed026d65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795dd3e7-7c74-483b-936f-1a9a3d01a158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:42 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Volume b35be7bb-b7ce-445b-a1c7-14b9a74a97b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2', 'volume_size': 1} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-530522692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35be7bb-b7ce-445b-a1c7-14b9a74a97b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf56e37c3c1405ca84000270976ce66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:43Z,use_quota=True,user_id='d8b984af9a2c482ba362242fed76fd2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Creating volume b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:21:42 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:21:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:42 devstack sudo[85588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 1073741824 Apr 17 16:21:42 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:43 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 1073741824" returned: 0 in 0.771s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:43 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 Apr 17 16:21:43 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:44 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2" returned: 0 in 0.556s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795dd3e7-7c74-483b-936f-1a9a3d01a158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64f74b2-bac1-4b41-bf88-5bbe57d9cd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:44 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Volume volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 (b35be7bb-b7ce-445b-a1c7-14b9a74a97b2): created successfully Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64f74b2-bac1-4b41-bf88-5bbe57d9cd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Flow 'volume_create_manager' (203f3288-ee86-4a72-8026-1c5b045cd05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:21:44 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-185dbaec-48fd-446b-971f-5a85132944bb tempest-VolumesTransfersV355Test-615932843 None] Created volume successfully. Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3116bdb-4429-4a76-824d-009176351935]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:45 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:21:45 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:45 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7513dbcc-297a-4db5-82b9-438135d2a9a5 tempest-VolumesTransfersV355Test-1900088036 None] Transfer volume completed successfully. Apr 17 16:21:45 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.604s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:45 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c49e0a-b902-4091-a275-b52906cb8a9b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:45 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:21:45 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:46 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.542s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.e4851bbf-b120-47a3-8a4c-27c6b67742aacfw8o33f.img {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:46 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.e4851bbf-b120-47a3-8a4c-27c6b67742aacfw8o33f.img Apr 17 16:21:46 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Acquiring lock "cinder-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Acquiring lock "cinder-quobyte-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-quobyte-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c6d7ed-8f33-48a5-966d-eb2c3161de5a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:46 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 Apr 17 16:21:46 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:47 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2" returned: 0 in 1.112s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:47 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2 Apr 17 16:21:47 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:48 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:48 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.e4851bbf-b120-47a3-8a4c-27c6b67742aacfw8o33f.img" returned: 0 in 2.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2" returned: 0 in 1.206s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[607c073d-0e21-4fad-bc28-6c3c2cc6cabf]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-quobyte-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2" released by "delete_volume" :: held 2.361s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Created reservations ['194755f3-52d3-4dae-b4b0-cbee505e9a64', '75e54e2a-63c2-4e20-880d-81f7e9bdcec3', 'b02778b9-fd01-4d04-89be-c62e0860a66a', '8c9460c7-e9d5-4e09-80d6-cf21003e792b'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:21:48 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:21:48 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:21:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:21:48 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:21:48 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:21:49 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.473s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:21:49 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Deleted volume successfully. Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2144bd2f-f56c-499c-8750-26bea976fe7f tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-b35be7bb-b7ce-445b-a1c7-14b9a74a97b2-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:21:49 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.718s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.e4851bbf-b120-47a3-8a4c-27c6b67742aacfw8o33f.img {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:21:49 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Converted 1024.00 MB image at 419.33 MB/s Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] e4851bbf-b120-47a3-8a4c-27c6b67742aa was raw, no need to convert to raw {{(pid=82061) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Flow 'volume_create_manager' (552c4bbd-d28a-4bcf-87dd-a64aff7054f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3229464-eb01-480b-86ee-27c3f383d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3229464-eb01-480b-86ee-27c3f383d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-594398725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f324ae8e-52de-4283-99e9-4e420a59cc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf56e37c3c1405ca84000270976ce66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:50Z,use_quota=True,user_id='d8b984af9a2c482ba362242fed76fd2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cdf3b4-9120-4470-98c3-0618f0e5676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cdf3b4-9120-4470-98c3-0618f0e5676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160a66de-5433-48c4-9b9a-8821572a0936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160a66de-5433-48c4-9b9a-8821572a0936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f324ae8e-52de-4283-99e9-4e420a59cc43', 'volume_name': 'volume-f324ae8e-52de-4283-99e9-4e420a59cc43', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fc09b1-4dc7-4db2-9f11-0ac457e5ee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fc09b1-4dc7-4db2-9f11-0ac457e5ee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c694b87-6757-4757-9718-ca51e18eac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:21:50 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Volume f324ae8e-52de-4283-99e9-4e420a59cc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f324ae8e-52de-4283-99e9-4e420a59cc43', 'volume_size': 1} Apr 17 16:21:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:21:59 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=50,cinder:INSERT=16,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:21:59 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=62,cinder:INSERT=17,cinder:UPDATE=68,cinder:DELETE=4 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:22:00 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f5702a53-1bd8-40df-a7f0-c187d486c2fe tempest-GroupsV314Test-956960351 None] Group tempest-GroupsV314Test-Group-1616300639: creating Apr 17 16:22:00 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f5702a53-1bd8-40df-a7f0-c187d486c2fe tempest-GroupsV314Test-956960351 None] Group tempest-GroupsV314Test-Group-1616300639: created successfully Apr 17 16:22:00 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f5702a53-1bd8-40df-a7f0-c187d486c2fe tempest-GroupsV314Test-956960351 None] Create group completed successfully. Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.048s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Uploaded volume to glance image-id: e4851bbf-b120-47a3-8a4c-27c6b67742aa. {{(pid=82061) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.984s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-594398725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f324ae8e-52de-4283-99e9-4e420a59cc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf56e37c3c1405ca84000270976ce66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:21:50Z,use_quota=True,user_id='d8b984af9a2c482ba362242fed76fd2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Creating volume f324ae8e-52de-4283-99e9-4e420a59cc43 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:01 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:01 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 1073741824 Apr 17 16:22:01 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f8915215-8b7b-4a3a-a48f-4583dc680f35 tempest-VolumesActionsTest-1927412870 None] Copy volume to image completed successfully. Apr 17 16:22:01 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Flow 'volume_create_manager' (eb9680ee-65d0-41b8-878c-630bb7a4d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cda13a-0547-4c6a-ac48-80a62348e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cda13a-0547-4c6a-ac48-80a62348e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368953303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=138f2e47-7c9a-40f0-b62c-f4defd65ed47,host='devstack@QuobyteHD#QuobyteHD',id=139bea5b-cddc-413f-8004-822f1ae45161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939b6e39dae64e5b834416f2ac34e849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:01Z,use_quota=True,user_id='b7c9abbbc6774c5794839dfc64294333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15ded455-9a91-478f-8ff0-c2572a463d61),volume_type_id=15ded455-9a91-478f-8ff0-c2572a463d61)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5461cd01-e0d3-458c-85a8-eea68922e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5461cd01-e0d3-458c-85a8-eea68922e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaee026a-3a95-43f4-a3d9-8ef56188c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaee026a-3a95-43f4-a3d9-8ef56188c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139bea5b-cddc-413f-8004-822f1ae45161', 'volume_name': 'volume-139bea5b-cddc-413f-8004-822f1ae45161', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affbda44-2d8f-45a1-a605-d5bb84d862ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affbda44-2d8f-45a1-a605-d5bb84d862ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609b0040-5e76-4950-8b4b-f233f822301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:01 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Volume 139bea5b-cddc-413f-8004-822f1ae45161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139bea5b-cddc-413f-8004-822f1ae45161', 'volume_size': 1} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:01 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 1073741824" returned: 0 in 0.644s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:01 devstack sudo[85716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 Apr 17 16:22:01 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:02 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43" returned: 0 in 0.529s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=138f2e47-7c9a-40f0-b62c-f4defd65ed47,created_at=2026-04-17T14:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368953303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=138f2e47-7c9a-40f0-b62c-f4defd65ed47,host='devstack@QuobyteHD#QuobyteHD',id=139bea5b-cddc-413f-8004-822f1ae45161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939b6e39dae64e5b834416f2ac34e849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:01Z,use_quota=True,user_id='b7c9abbbc6774c5794839dfc64294333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15ded455-9a91-478f-8ff0-c2572a463d61),volume_type_id=15ded455-9a91-478f-8ff0-c2572a463d61)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Creating volume 139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:02 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c694b87-6757-4757-9718-ca51e18eac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f324ae8e-52de-4283-99e9-4e420a59cc43', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:02 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 1073741824 Apr 17 16:22:02 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8b751e-9cf1-4952-8d2c-8060aa9414e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:02 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Volume volume-f324ae8e-52de-4283-99e9-4e420a59cc43 (f324ae8e-52de-4283-99e9-4e420a59cc43): created successfully Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8b751e-9cf1-4952-8d2c-8060aa9414e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Flow 'volume_create_manager' (552c4bbd-d28a-4bcf-87dd-a64aff7054f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e1e56b66-1af9-47ba-8b10-5302d7f2183a tempest-VolumesTransfersV355Test-615932843 None] Created volume successfully. Apr 17 16:22:02 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 1073741824" returned: 0 in 0.531s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:02 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 Apr 17 16:22:02 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Acquiring lock "cinder-f324ae8e-52de-4283-99e9-4e420a59cc43-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-f324ae8e-52de-4283-99e9-4e420a59cc43-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Acquiring lock "cinder-quobyte-f324ae8e-52de-4283-99e9-4e420a59cc43" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-quobyte-f324ae8e-52de-4283-99e9-4e420a59cc43" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ddffc-471c-4920-959b-2e100036d070]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:03 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 Apr 17 16:22:03 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:03 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161" returned: 0 in 0.489s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.064s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609b0040-5e76-4950-8b4b-f233f822301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139bea5b-cddc-413f-8004-822f1ae45161', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba99032-48dc-4d26-940b-18df2f46a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757a5ef-c841-4fab-890e-2c7ebb19b025]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Volume volume-139bea5b-cddc-413f-8004-822f1ae45161 (139bea5b-cddc-413f-8004-822f1ae45161): created successfully Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba99032-48dc-4d26-940b-18df2f46a606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Flow 'volume_create_manager' (eb9680ee-65d0-41b8-878c-630bb7a4d286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-823cf60c-0f31-4882-af15-3d05c3d2454a tempest-GroupsV314Test-956960351 None] Created volume successfully. Apr 17 16:22:03 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:22:03 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:03 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:03 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43 Apr 17 16:22:03 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:03 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.519s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c10e3-939e-4e8a-ab9b-572281182f51]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:03 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:22:03 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:04 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f324ae8e-52de-4283-99e9-4e420a59cc43" returned: 0 in 0.444s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-quobyte-f324ae8e-52de-4283-99e9-4e420a59cc43" released by "delete_volume" :: held 0.991s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Created reservations ['e9090fc7-e73a-4b8a-8441-fcc974f69905', '8ea4e1f5-a98e-45be-b5f6-8a8b74345f62', 'bffcda77-f7a9-4a75-b4ab-1f1866538959', '9abd7cb7-751b-412a-90f8-a59f397caae3'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:04 devstack sudo[85749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:04 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:04 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.513s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:04 devstack sudo[85751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img Apr 17 16:22:04 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:04 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Deleted volume successfully. Apr 17 16:22:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ad12bf86-b069-4e48-ae8f-7d27a53ef687 tempest-VolumesTransfersV355Test-1301697159 None] Lock "cinder-f324ae8e-52de-4283-99e9-4e420a59cc43-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:06 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img" returned: 0 in 2.653s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c669a-30d9-4b9e-ae35-b45566044248]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:07 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:22:07 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:07 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.833s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:07 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:22:07 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Converted 1024.00 MB image at 385.55 MB/s Apr 17 16:22:07 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] bf3047ba-9dbf-407a-9500-581a2073ab85 was raw, converting to qcow2 {{(pid=82061) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 17 16:22:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eecaf8-eb92-4669-9fbe-8a8298fff8e0]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:08 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img Apr 17 16:22:08 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:08 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img" returned: 0 in 0.602s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:08 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img Apr 17 16:22:08 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:09 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img" returned: 1 in 0.621s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:22:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img /opt/stack/data/cinder/conversion/vol_upload_xmdq1nar {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:09 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img /opt/stack/data/cinder/conversion/vol_upload_xmdq1nar Apr 17 16:22:09 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:09 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img /opt/stack/data/cinder/conversion/vol_upload_xmdq1nar" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:09 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Image conversion details: src /opt/stack/data/cinder/conversion/577dafb9-c1cc-4172-ae36-0e2cd8dd07e4.temp_image.bf3047ba-9dbf-407a-9500-581a2073ab854ug974hj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xmdq1nar {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:22:09 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 17 16:22:09 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5946aa8d-d6a3-4bfc-83ec-0aa2d40f75ba]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xmdq1nar {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:09 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xmdq1nar Apr 17 16:22:09 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:10 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xmdq1nar" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Flow 'volume_create_manager' (76608c28-87dd-4e2d-adf4-240a4df013c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b482afcc-88af-454a-be89-c9530cefd37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b482afcc-88af-454a-be89-c9530cefd37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1138301910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a09f8c-5776-4252-be8e-ede7df597dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f7397f697d43fab5bbdc161599ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:11Z,use_quota=True,user_id='dbb401634545409094c2926bff1a21a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cf3be8-e1d6-498e-ab61-83493464bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cf3be8-e1d6-498e-ab61-83493464bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e171f185-0d41-4392-8b1d-ea27f7aacac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e171f185-0d41-4392-8b1d-ea27f7aacac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a09f8c-5776-4252-be8e-ede7df597dfe', 'volume_name': 'volume-f8a09f8c-5776-4252-be8e-ede7df597dfe', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c51c9d-2cb4-46df-bb10-873806147439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c51c9d-2cb4-46df-bb10-873806147439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3646cce6-0023-4196-ba75-51461524e603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:11 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Volume f8a09f8c-5776-4252-be8e-ede7df597dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a09f8c-5776-4252-be8e-ede7df597dfe', 'volume_size': 1} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.967s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Uploaded volume to glance image-id: bf3047ba-9dbf-407a-9500-581a2073ab85. {{(pid=82061) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.766s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:11 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Cloning volume 139bea5b-cddc-413f-8004-822f1ae45161 to volume fb98c766-4dc5-4f33-8ec2-482da618dbfa Apr 17 16:22:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-49e64975-43dc-45e5-ab6f-e062c107154a tempest-VolumesActionsTest-1927412870 None] Copy volume to image completed successfully. Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Creating offline snapshot 89d70999-46cd-4ac9-b009-8a4ab32b52ce of volume 139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f51820-2b13-4468-bc9c-670517ea8b5f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:11 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 Apr 17 16:22:11 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:11 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:11 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce 1G Apr 17 16:22:11 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "cinder-quobyte-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-quobyte-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be10814-a87e-4308-a329-5c89f7279047]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:12 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:22:12 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:12 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce 1G" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139bea5b-cddc-413f-8004-822f1ae45161 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:12 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139bea5b-cddc-413f-8004-822f1ae45161 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce Apr 17 16:22:12 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:12 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.550s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:12 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4 Apr 17 16:22:12 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:12 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139bea5b-cddc-413f-8004-822f1ae45161 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce" returned: 0 in 0.480s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:12 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:22:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:12 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce Apr 17 16:22:12 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:13 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" returned: 0 in 0.423s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-quobyte-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4" released by "delete_volume" :: held 0.996s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Created reservations ['acb38375-1b1c-41f4-af8a-83fa1b360ad9', '2dc71bc1-bead-4deb-9b25-260e629c967e', 'd706af94-c25e-42bb-b24d-3a7d29255bbd', 'b6e0f39f-e8b9-4808-8b39-4118d75e8f46'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:13 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:13 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:13 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce" returned: 0 in 0.430s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:13 devstack sudo[85837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.info Apr 17 16:22:13 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:13 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.701s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:13 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Deleted volume successfully. Apr 17 16:22:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d26f6afd-f130-4d81-84f3-168fa9b96dc3 tempest-VolumesActionsTest-1927412870 None] Lock "cinder-577dafb9-c1cc-4172-ae36-0e2cd8dd07e4-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:14 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.info" returned: 0 in 0.748s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:14 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:14 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.info Apr 17 16:22:14 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:14 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.info" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Acquiring lock "cinder-quobyte-fb98c766-4dc5-4f33-8ec2-482da618dbfa" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-fb98c766-4dc5-4f33-8ec2-482da618dbfa" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] snapshot: 89d70999-46cd-4ac9-b009-8a4ab32b52ce, volume: fb98c766-4dc5-4f33-8ec2-482da618dbfa, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d67f74-4644-40e1-b4ee-438829f5b9ea]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:14 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce Apr 17 16:22:14 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:15 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce" returned: 0 in 0.714s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139bea5b-cddc-413f-8004-822f1ae45161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a64055-5343-47d0-be55-8caa294538b7]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:15 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 Apr 17 16:22:15 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:15 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161" returned: 0 in 0.613s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:22:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:15 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa Apr 17 16:22:15 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:19 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa" returned: 0 in 3.138s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:19 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0cf6f6-f321-4fc2-8e5a-b6e41b95d942]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:19 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 Apr 17 16:22:19 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:19 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161" returned: 0 in 0.835s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:19 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161, size 1024.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:22:19 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Converted 1024.00 MB image at 326.21 MB/s Apr 17 16:22:19 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:22:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:19 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa Apr 17 16:22:19 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:20 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa" returned: 0 in 0.554s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-fb98c766-4dc5-4f33-8ec2-482da618dbfa" released by "_copy_volume_from_snapshot" :: held 5.927s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Acquiring lock "cinder-quobyte-89d70999-46cd-4ac9-b009-8a4ab32b52ce" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-89d70999-46cd-4ac9-b009-8a4ab32b52ce" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Deleting offline snapshot 89d70999-46cd-4ac9-b009-8a4ab32b52ce of volume 139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] snapshot_file for this snap is: volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff79e07-4a57-47c7-90fa-6a2f0300b32e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:20 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce Apr 17 16:22:20 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:21 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Flow 'volume_create_manager' (8a617384-48c7-43e4-903f-2c0930d19d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f3f69a-e684-4695-a61c-89753c5f8753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce" returned: 0 in 0.615s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139bea5b-cddc-413f-8004-822f1ae45161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f2069b-952b-4757-be60-fcd108fd7a80]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f3f69a-e684-4695-a61c-89753c5f8753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-558380644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b184ab3f-65cf-455f-bdd1-39fa046758b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8d2371aba443d89afffdce489e9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:21Z,use_quota=True,user_id='2a2f3583f6ae4252b3d87ddaf14fabab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674e5d6e-7dfd-42f9-b178-ef9f1f5ee1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674e5d6e-7dfd-42f9-b178-ef9f1f5ee1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e410dd-ed80-4f05-8bd1-b59c665c8a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e410dd-ed80-4f05-8bd1-b59c665c8a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b184ab3f-65cf-455f-bdd1-39fa046758b4', 'volume_name': 'volume-b184ab3f-65cf-455f-bdd1-39fa046758b4', 'volume_size': 2}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d2626d-b45f-4ed3-9e95-f1a0a38a22c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d2626d-b45f-4ed3-9e95-f1a0a38a22c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8442ed3a-6b4a-4d97-8784-e11a67133605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:21 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Volume b184ab3f-65cf-455f-bdd1-39fa046758b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b184ab3f-65cf-455f-bdd1-39fa046758b4', 'volume_size': 2} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:21 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 Apr 17 16:22:21 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:21 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161" returned: 0 in 0.576s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:21 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce Apr 17 16:22:21 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:22 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce" returned: 0 in 0.528s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:22 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce Apr 17 16:22:22 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:22 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161.89d70999-46cd-4ac9-b009-8a4ab32b52ce" returned: 0 in 0.440s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-89d70999-46cd-4ac9-b009-8a4ab32b52ce" released by "_delete_snapshot" :: held 2.216s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.484s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.661s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1138301910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a09f8c-5776-4252-be8e-ede7df597dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f7397f697d43fab5bbdc161599ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:11Z,use_quota=True,user_id='dbb401634545409094c2926bff1a21a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Creating volume f8a09f8c-5776-4252-be8e-ede7df597dfe {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:22 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:22 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe 1073741824 Apr 17 16:22:22 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:22 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-9026378a-2e3d-4580-ac25-5668335f23ba tempest-GroupsV314Test-956960351 None] Create group from source-group-138f2e47-7c9a-40f0-b62c-f4defd65ed47 completed successfully. Apr 17 16:22:23 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe 1073741824" returned: 0 in 0.536s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:23 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe Apr 17 16:22:23 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Acquiring lock "cinder-quobyte-fb98c766-4dc5-4f33-8ec2-482da618dbfa" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-fb98c766-4dc5-4f33-8ec2-482da618dbfa" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:24 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a04093-8859-4bae-988a-a54a33a8778c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe" returned: 0 in 0.709s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-558380644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b184ab3f-65cf-455f-bdd1-39fa046758b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8d2371aba443d89afffdce489e9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:21Z,use_quota=True,user_id='2a2f3583f6ae4252b3d87ddaf14fabab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Creating volume b184ab3f-65cf-455f-bdd1-39fa046758b4 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:24 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 2147483648 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3646cce6-0023-4196-ba75-51461524e603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a09f8c-5776-4252-be8e-ede7df597dfe', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167deb2c-fb22-47a4-96b5-505ee22bd263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:24 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Volume volume-f8a09f8c-5776-4252-be8e-ede7df597dfe (f8a09f8c-5776-4252-be8e-ede7df597dfe): created successfully Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167deb2c-fb22-47a4-96b5-505ee22bd263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Flow 'volume_create_manager' (76608c28-87dd-4e2d-adf4-240a4df013c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:24 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 2147483648 Apr 17 16:22:24 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:24 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ba235940-7ad6-4835-98db-55fc903a7a18 tempest-VolumesTransfersV357Test-1018529936 None] Created volume successfully. Apr 17 16:22:24 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa Apr 17 16:22:24 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:24 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa" returned: 0 in 0.592s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:24 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa Apr 17 16:22:24 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:24 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 2147483648" returned: 0 in 0.749s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:24 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 Apr 17 16:22:24 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:25 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb98c766-4dc5-4f33-8ec2-482da618dbfa" returned: 0 in 0.575s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-fb98c766-4dc5-4f33-8ec2-482da618dbfa" released by "delete_volume" :: held 1.223s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Created reservations ['c7d3a37b-4a53-4611-bfb7-51fd6db6aca6'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:25 devstack cinder-volume[82061]: WARNING cinder.quota [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-974526172 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-974526172, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:22:25 devstack cinder-volume[82061]: WARNING cinder.quota [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-974526172 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-974526172, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Created reservations ['f104fbf1-7ac4-48bc-b2bf-f20711b1213b', 'eb4ca6f3-b7ae-412f-963f-ff4269ca5d30', 'f1669ebb-642e-4dd5-ac8c-1c0f75626df7', '9d7b7fa0-2281-4551-b3c7-71f4d461939f'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:25 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4" returned: 0 in 0.547s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8442ed3a-6b4a-4d97-8784-e11a67133605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b184ab3f-65cf-455f-bdd1-39fa046758b4', 'volume_size': 2}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce83f3c9-ca7d-4d82-8862-7e9204f54034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:25 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:25 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:25 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Volume volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 (b184ab3f-65cf-455f-bdd1-39fa046758b4): created successfully Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce83f3c9-ca7d-4d82-8862-7e9204f54034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Flow 'volume_create_manager' (8a617384-48c7-43e4-903f-2c0930d19d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ed7e98b7-d005-43e4-b336-a8849edd85ff tempest-VolumesCloneNegativeTest-451014780 None] Created volume successfully. Apr 17 16:22:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-505b406d-0f9f-46f9-9085-d88c7dc0997f tempest-VolumesTransfersV357Test-308854325 None] Transfer volume completed successfully. Apr 17 16:22:25 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.514s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:25 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-41fe8f02-8add-462e-a086-9cd89382fead tempest-GroupsV314Test-956960351 None] Delete group completed successfully. Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Acquiring lock "cinder-quobyte-139bea5b-cddc-413f-8004-822f1ae45161" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-139bea5b-cddc-413f-8004-822f1ae45161" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[15129b4b-d14c-48bd-8ee5-11633fb89440]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:26 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 Apr 17 16:22:26 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Acquiring lock "cinder-b184ab3f-65cf-455f-bdd1-39fa046758b4-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Lock "cinder-b184ab3f-65cf-455f-bdd1-39fa046758b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Acquiring lock "cinder-quobyte-b184ab3f-65cf-455f-bdd1-39fa046758b4" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Acquiring lock "cinder-f8a09f8c-5776-4252-be8e-ede7df597dfe-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Lock "cinder-quobyte-b184ab3f-65cf-455f-bdd1-39fa046758b4" acquired by "delete_volume" :: waited 0.029s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-f8a09f8c-5776-4252-be8e-ede7df597dfe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[33083df0-a39a-4bca-a9cd-adbc2e74d36f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Acquiring lock "cinder-quobyte-f8a09f8c-5776-4252-be8e-ede7df597dfe" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:26 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 Apr 17 16:22:26 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-quobyte-f8a09f8c-5776-4252-be8e-ede7df597dfe" acquired by "delete_volume" :: waited 0.019s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8baad3-4619-4108-97d1-07e9b4b17ed8]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:26 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe Apr 17 16:22:26 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:27 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161" returned: 0 in 0.837s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:27 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161 Apr 17 16:22:27 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:27 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4" returned: 0 in 0.576s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:27 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4 Apr 17 16:22:27 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:27 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe" returned: 0 in 0.576s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:27 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe Apr 17 16:22:27 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:27 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-139bea5b-cddc-413f-8004-822f1ae45161" returned: 0 in 0.437s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Lock "cinder-quobyte-139bea5b-cddc-413f-8004-822f1ae45161" released by "delete_volume" :: held 1.308s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Created reservations ['312316b0-61d9-42fa-80bb-352ef64aecc7'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Created reservations ['2bb807f6-11c1-485f-ab58-348d5e99d993', '7329c2b9-f476-4e9a-b833-3c03c943d88e', '95c73625-58d2-476f-a44a-43680695559e', '10beb472-5b5e-4331-857e-d4998864f8b2'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:27 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b184ab3f-65cf-455f-bdd1-39fa046758b4" returned: 0 in 0.551s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Lock "cinder-quobyte-b184ab3f-65cf-455f-bdd1-39fa046758b4" released by "delete_volume" :: held 1.159s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:27 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:27 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Created reservations ['afa8ba72-f1a4-4dae-9334-9bf32ebad235', '031694e2-1ef6-4144-88ef-f985ee0f63a8', '6a05f97c-fc5a-47b1-a8ca-f092a93f2ea5', 'd7e71e63-268a-4157-b0de-53a4d858b8ac'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:27 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f8a09f8c-5776-4252-be8e-ede7df597dfe" returned: 0 in 0.507s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-quobyte-f8a09f8c-5776-4252-be8e-ede7df597dfe" released by "delete_volume" :: held 1.123s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Created reservations ['2e061040-0fab-4328-9a44-b799dd296607', '7a8969e6-a1e9-4554-9ee0-f46e1dfdcdf0', 'd9255575-65db-44dc-996b-0602121149ea', '4a1633a1-1ac4-44cd-9906-c6d52396ab4d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:28 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:28 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:28 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:28 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:28 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.533s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:28 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ea5292c7-6136-4720-83c7-e05c50bf620d tempest-GroupsV314Test-956960351 None] Delete group completed successfully. Apr 17 16:22:28 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:28 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Deleted volume successfully. Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-376b235c-245a-4563-ae97-566496ebb0b6 tempest-VolumesCloneNegativeTest-451014780 None] Lock "cinder-b184ab3f-65cf-455f-bdd1-39fa046758b4-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:28 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.518s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:28 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Deleted volume successfully. Apr 17 16:22:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0835a65d-7d73-4c42-ada0-322afeddf2df tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-f8a09f8c-5776-4252-be8e-ede7df597dfe-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Flow 'volume_create_manager' (2e620cb6-86ec-4997-8b86-6c93869351a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fa4a0a-f42b-4bb8-89fe-62aca805034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fa4a0a-f42b-4bb8-89fe-62aca805034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-477117274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5420e2-a80f-41cf-beba-95c34ddd04ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f7397f697d43fab5bbdc161599ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:29Z,use_quota=True,user_id='dbb401634545409094c2926bff1a21a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f89421-7de8-4c93-ad67-0783b2f38345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f89421-7de8-4c93-ad67-0783b2f38345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ae6686-af2e-4e50-a021-e2816b1d0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ae6686-af2e-4e50-a021-e2816b1d0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5420e2-a80f-41cf-beba-95c34ddd04ae', 'volume_name': 'volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df3fd9-451a-47cd-b964-e51399ed338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df3fd9-451a-47cd-b964-e51399ed338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b57e4e2-1e5a-4ea2-b8da-d95c90bb9234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:29 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Volume cb5420e2-a80f-41cf-beba-95c34ddd04ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae', 'volume_size': 1} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-477117274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5420e2-a80f-41cf-beba-95c34ddd04ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f7397f697d43fab5bbdc161599ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:29Z,use_quota=True,user_id='dbb401634545409094c2926bff1a21a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Creating volume cb5420e2-a80f-41cf-beba-95c34ddd04ae {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:29 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:29 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae 1073741824 Apr 17 16:22:29 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:30 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae 1073741824" returned: 0 in 1.057s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:30 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae Apr 17 16:22:30 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:31 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae" returned: 0 in 0.878s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b57e4e2-1e5a-4ea2-b8da-d95c90bb9234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7502f34-89df-4b8f-8dde-49d257c6b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:31 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Volume volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae (cb5420e2-a80f-41cf-beba-95c34ddd04ae): created successfully Apr 17 16:22:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7502f34-89df-4b8f-8dde-49d257c6b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Flow 'volume_create_manager' (2e620cb6-86ec-4997-8b86-6c93869351a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-01a42964-c3b4-4468-8c15-64c056fbc52f tempest-VolumesTransfersV357Test-1018529936 None] Created volume successfully. Apr 17 16:22:32 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (d8a49ffb-dce9-4268-8faa-f5866f7c5427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c88b0-0e2f-4808-b7d1-0ba7801ab03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Acquiring lock "cinder-cb5420e2-a80f-41cf-beba-95c34ddd04ae-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c88b0-0e2f-4808-b7d1-0ba7801ab03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-972366270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:33Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07df9a37-6fd6-4b3a-b397-be5c03f4b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07df9a37-6fd6-4b3a-b397-be5c03f4b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291c0949-a910-4918-81ba-3d2c0c359153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291c0949-a910-4918-81ba-3d2c0c359153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff', 'volume_name': 'volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a0a5af-4f74-47b6-a641-b925ec8fa383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a0a5af-4f74-47b6-a641-b925ec8fa383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eefe038-5f80-454e-944c-c732625b401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Volume 316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff', 'volume_size': 1} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-972366270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:33Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Creating volume 316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:33 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-cb5420e2-a80f-41cf-beba-95c34ddd04ae-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:33 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff 1073741824 Apr 17 16:22:33 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Acquiring lock "cinder-quobyte-cb5420e2-a80f-41cf-beba-95c34ddd04ae" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-quobyte-cb5420e2-a80f-41cf-beba-95c34ddd04ae" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ebbb75-a483-4b40-947d-5b2a760155f4]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:33 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae Apr 17 16:22:33 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:33 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:33 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:33 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae" returned: 0 in 0.747s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:34 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae Apr 17 16:22:34 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:34 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff 1073741824" returned: 0 in 1.107s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:34 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff Apr 17 16:22:34 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:34 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.768s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:34 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cb5420e2-a80f-41cf-beba-95c34ddd04ae" returned: 0 in 0.635s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-quobyte-cb5420e2-a80f-41cf-beba-95c34ddd04ae" released by "delete_volume" :: held 1.419s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Created reservations ['5dbcaa27-99f1-4bb0-a2a2-b409e9730283', '765a9baf-6ad0-4796-bb97-2c4dd0b3479b', '4d7e9582-e2ec-4d8d-a275-eb17a4ce2caa', '4bb174d9-3f77-433b-a1e7-08b278245529'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:34 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:34 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:34 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff" returned: 0 in 0.615s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eefe038-5f80-454e-944c-c732625b401f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a936ced-2510-4e98-8e0a-51e2ba60a176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:34 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Volume volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff (316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff): created successfully Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a936ced-2510-4e98-8e0a-51e2ba60a176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (d8a49ffb-dce9-4268-8faa-f5866f7c5427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:34 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-adc0907f-ad43-4fce-ae3d-3170234c29c2 tempest-VolumesGetTest-1751323440 None] Created volume successfully. Apr 17 16:22:35 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.844s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:35 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Deleted volume successfully. Apr 17 16:22:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7247f001-d772-4239-abf3-38f5613b3d9b tempest-VolumesTransfersV357Test-938682752 None] Lock "cinder-cb5420e2-a80f-41cf-beba-95c34ddd04ae-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:35 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (02cf02cb-32fe-4da5-8d55-d9181a8c3a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c14652e-e425-46c2-9fc6-48eb67f0e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c14652e-e425-46c2-9fc6-48eb67f0e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1008823809',display_name='tempest-VolumesGetTest-Volume-905205168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c09d92f-fe30-4f76-907d-4322bae1ab15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:36Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da02fec0-899c-4c42-8c8f-0513252d3cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da02fec0-899c-4c42-8c8f-0513252d3cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1095897-1dca-46bc-89ea-877a85ac1696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1095897-1dca-46bc-89ea-877a85ac1696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c09d92f-fe30-4f76-907d-4322bae1ab15', 'volume_name': 'volume-5c09d92f-fe30-4f76-907d-4322bae1ab15', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61506187-e7a0-420f-b2db-4b1135e2181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61506187-e7a0-420f-b2db-4b1135e2181d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbe51e1-8b34-4c66-92b9-62cc25b67a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Volume 5c09d92f-fe30-4f76-907d-4322bae1ab15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c09d92f-fe30-4f76-907d-4322bae1ab15', 'volume_size': 1} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1008823809',display_name='tempest-VolumesGetTest-Volume-905205168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c09d92f-fe30-4f76-907d-4322bae1ab15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:36Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Creating volume 5c09d92f-fe30-4f76-907d-4322bae1ab15 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:36 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:36 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 1073741824 Apr 17 16:22:36 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:36 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 1073741824" returned: 0 in 0.742s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:36 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 Apr 17 16:22:36 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:37 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15" returned: 0 in 0.670s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbe51e1-8b34-4c66-92b9-62cc25b67a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c09d92f-fe30-4f76-907d-4322bae1ab15', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f330d61-3f35-4b67-bf92-d237af400bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:37 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Volume volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 (5c09d92f-fe30-4f76-907d-4322bae1ab15): created successfully Apr 17 16:22:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f330d61-3f35-4b67-bf92-d237af400bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (02cf02cb-32fe-4da5-8d55-d9181a8c3a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-206ad560-df82-4706-baff-62ca40eb9813 tempest-VolumesGetTest-1751323440 None] Created volume successfully. Apr 17 16:22:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-5c09d92f-fe30-4f76-907d-4322bae1ab15-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Lock "cinder-5c09d92f-fe30-4f76-907d-4322bae1ab15-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-5c09d92f-fe30-4f76-907d-4322bae1ab15" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-5c09d92f-fe30-4f76-907d-4322bae1ab15" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:38 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac52aa9-5c29-4662-bd05-230ac966e12e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:38 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 Apr 17 16:22:38 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:39 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15" returned: 0 in 0.807s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:39 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15 Apr 17 16:22:39 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:39 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5c09d92f-fe30-4f76-907d-4322bae1ab15" returned: 0 in 0.748s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-5c09d92f-fe30-4f76-907d-4322bae1ab15" released by "delete_volume" :: held 1.584s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Flow 'volume_create_manager' (93f8227f-1a5b-4afd-8dfd-d6e64a37d53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f132e9-e46b-42a6-bd31-238ef05e38a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f132e9-e46b-42a6-bd31-238ef05e38a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1779019887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f843d0e3-8e11-4673-8a00-b05c60e2796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c03e4c5843f46c79275192f2ebab2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:40Z,use_quota=True,user_id='c611a976835d476d87bc7e42df2d02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d1744d-aeda-406f-a8a1-7f3242580a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d1744d-aeda-406f-a8a1-7f3242580a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3deca5-8139-4aa9-815e-05fe132c7770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3deca5-8139-4aa9-815e-05fe132c7770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f843d0e3-8e11-4673-8a00-b05c60e2796b', 'volume_name': 'volume-f843d0e3-8e11-4673-8a00-b05c60e2796b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a567de-aea9-4144-b3bf-0cb95f7873c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a567de-aea9-4144-b3bf-0cb95f7873c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2434f02-a453-4e83-8d44-5d305f82d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:39 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Volume f843d0e3-8e11-4673-8a00-b05c60e2796b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f843d0e3-8e11-4673-8a00-b05c60e2796b', 'volume_size': 1} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1779019887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f843d0e3-8e11-4673-8a00-b05c60e2796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c03e4c5843f46c79275192f2ebab2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:40Z,use_quota=True,user_id='c611a976835d476d87bc7e42df2d02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Creating volume f843d0e3-8e11-4673-8a00-b05c60e2796b {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:39 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Created reservations ['f061ac03-4b4c-4475-9f26-913e4f897fcf', '7aa021a4-2f28-49af-b446-c3555eb91976', '9c362d9f-d21e-4638-bd3b-30704807db31', '19798d41-5247-4f72-8c76-68d17a10fb11'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:40 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b 1073741824 Apr 17 16:22:40 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:40 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:40 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Lock "cinder-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff" acquired by "delete_volume" :: waited 0.031s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532454e-a30a-4a83-baf7-430d08144dd7]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:40 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff Apr 17 16:22:40 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:40 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b 1073741824" returned: 0 in 0.958s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:40 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.870s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:40 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Deleted volume successfully. Apr 17 16:22:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f323a587-5b6f-4e96-a46f-7b2912ee31df tempest-VolumesGetTest-1751323440 None] Lock "cinder-5c09d92f-fe30-4f76-907d-4322bae1ab15-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:41 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b Apr 17 16:22:41 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:41 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b" returned: 0 in 0.500s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2434f02-a453-4e83-8d44-5d305f82d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f843d0e3-8e11-4673-8a00-b05c60e2796b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f95cd6-2f4c-4c43-bd6b-34cebfc56eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:41 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Volume volume-f843d0e3-8e11-4673-8a00-b05c60e2796b (f843d0e3-8e11-4673-8a00-b05c60e2796b): created successfully Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f95cd6-2f4c-4c43-bd6b-34cebfc56eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:41 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Flow 'volume_create_manager' (93f8227f-1a5b-4afd-8dfd-d6e64a37d53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff" returned: 0 in 0.829s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c81c6cdc-70ba-4512-9263-a87a8e96529e tempest-ServersNegativeTestJSON-109160360 None] Created volume successfully. Apr 17 16:22:41 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff Apr 17 16:22:41 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:41 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff" released by "delete_volume" :: held 1.335s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Created reservations ['b6658be8-cb2a-49c6-aae3-c30a9cd3edc1', '22f1fccd-5f4a-4391-a144-38dc05cf7fd8', 'c6fc4efc-6dfb-4be7-8c0c-177b5c023ec6', '26ed3546-9c20-45c1-bb9b-77a7219df14b'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:42 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:42 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:42 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.554s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:42 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Deleted volume successfully. Apr 17 16:22:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fbbab13-ab14-4430-90da-806e3c861b6e tempest-VolumesGetTest-1751323440 None] Lock "cinder-316b9cb3-3f7a-48d0-a774-b2df4bdfb8ff-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (b52a9d34-e0c6-49cf-8228-afb9e6274b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d339bf40-6a01-41ae-951b-e61f6adc63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d339bf40-6a01-41ae-951b-e61f6adc63db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-798178311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc963bb4-1d36-446a-892d-b8f36cf8c2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:43Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b489dc83-7c43-4e32-a0e3-b2daf10cc537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b489dc83-7c43-4e32-a0e3-b2daf10cc537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c120a31-009d-448c-a4d6-230ddf5ecc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c120a31-009d-448c-a4d6-230ddf5ecc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc963bb4-1d36-446a-892d-b8f36cf8c2f3', 'volume_name': 'volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b44de90-cb40-4bb9-9787-be9dc2737a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b44de90-cb40-4bb9-9787-be9dc2737a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8790a8a-2ad4-40a5-bcaf-54d7d6b404f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:43 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Volume fc963bb4-1d36-446a-892d-b8f36cf8c2f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3', 'volume_size': 1} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-798178311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc963bb4-1d36-446a-892d-b8f36cf8c2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:43Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Creating volume fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:43 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:43 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 1073741824 Apr 17 16:22:43 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:43 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 1073741824" returned: 0 in 0.594s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:43 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 Apr 17 16:22:43 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:44 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" returned: 0 in 0.666s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8790a8a-2ad4-40a5-bcaf-54d7d6b404f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5363820b-14ca-4c68-a3b0-1dd382c250fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:44 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Volume volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 (fc963bb4-1d36-446a-892d-b8f36cf8c2f3): created successfully Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5363820b-14ca-4c68-a3b0-1dd382c250fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (b52a9d34-e0c6-49cf-8228-afb9e6274b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:44 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ea0f52f8-4776-446d-9666-417128fd35c2 tempest-VolumesGetTest-1751323440 None] Created volume successfully. Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Flow 'volume_create_manager' (51bcbf45-dc0d-44f4-962b-ce8f111da608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f353e3a-9e6d-4394-94cc-33667759c515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f353e3a-9e6d-4394-94cc-33667759c515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1057806449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d58ceb-3f7b-456c-a04f-23abd25a8e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c03e4c5843f46c79275192f2ebab2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:45Z,use_quota=True,user_id='c611a976835d476d87bc7e42df2d02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31831f71-bd98-4ce5-a8aa-5f458ca7a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31831f71-bd98-4ce5-a8aa-5f458ca7a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8d6a5b-6d73-4374-a090-d6afdd80ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8d6a5b-6d73-4374-a090-d6afdd80ec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d58ceb-3f7b-456c-a04f-23abd25a8e52', 'volume_name': 'volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed53dadf-7c96-43df-bf40-d2835c6e28e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed53dadf-7c96-43df-bf40-d2835c6e28e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299392cc-1033-400b-b07a-f23a1f736973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:44 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Volume 76d58ceb-3f7b-456c-a04f-23abd25a8e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52', 'volume_size': 1} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1057806449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d58ceb-3f7b-456c-a04f-23abd25a8e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c03e4c5843f46c79275192f2ebab2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:45Z,use_quota=True,user_id='c611a976835d476d87bc7e42df2d02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Creating volume 76d58ceb-3f7b-456c-a04f-23abd25a8e52 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:44 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:45 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 1073741824 Apr 17 16:22:45 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:45 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 1073741824" returned: 0 in 0.890s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:45 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (36e988c9-0941-4cc5-8b9c-91310ae1be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8c567a-e770-471e-a020-2b72c75db06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8c567a-e770-471e-a020-2b72c75db06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1225318165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ff3245-7c2a-434d-9bcf-53969d637eec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fc963bb4-1d36-446a-892d-b8f36cf8c2f3,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:46Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9153c75c-67fe-4672-b62d-7ef5cedfe2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9153c75c-67fe-4672-b62d-7ef5cedfe2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef37b8-53ff-4da0-9744-94dee6d00f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef37b8-53ff-4da0-9744-94dee6d00f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e0ff3245-7c2a-434d-9bcf-53969d637eec', 'volume_name': 'volume-e0ff3245-7c2a-434d-9bcf-53969d637eec', 'volume_size': 1, 'source_volid': 'fc963bb4-1d36-446a-892d-b8f36cf8c2f3', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c42e50a-513d-428c-bb76-3b01bc598546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c42e50a-513d-428c-bb76-3b01bc598546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b33f704-2051-44ff-b6a0-cdd77329f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:46 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Volume e0ff3245-7c2a-434d-9bcf-53969d637eec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e0ff3245-7c2a-434d-9bcf-53969d637eec', 'volume_size': 1, 'source_volid': 'fc963bb4-1d36-446a-892d-b8f36cf8c2f3', 'source_volstatus': 'available'} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:46 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 Apr 17 16:22:46 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:46 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52" returned: 0 in 0.842s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.836s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:46 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Cloning volume fc963bb4-1d36-446a-892d-b8f36cf8c2f3 to volume e0ff3245-7c2a-434d-9bcf-53969d637eec Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Creating offline snapshot 1e694364-ec36-42a6-9e4b-6a5e7771be52 of volume fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299392cc-1033-400b-b07a-f23a1f736973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8885fb38-1b31-4004-85ad-15d5d84d4cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:47 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[144904be-7132-4e63-a856-8289647ffd18]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:47 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Volume volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 (76d58ceb-3f7b-456c-a04f-23abd25a8e52): created successfully Apr 17 16:22:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8885fb38-1b31-4004-85ad-15d5d84d4cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Flow 'volume_create_manager' (51bcbf45-dc0d-44f4-962b-ce8f111da608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:47 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c52a376b-63c9-4b00-9c29-c7bf9c1c40af tempest-ServersNegativeTestJSON-109160360 None] Created volume successfully. Apr 17 16:22:47 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 Apr 17 16:22:47 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:47 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" returned: 0 in 0.731s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:47 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 1G Apr 17 16:22:47 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:48 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (1cf9bed2-f36b-42ce-afc3-da64874259b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f983bb-833a-4d92-827d-d3ec9380882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 1G" returned: 0 in 0.746s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f983bb-833a-4d92-827d-d3ec9380882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-804009779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed48195-bb1a-4291-bb7d-d61b97e4c09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:48Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7674ccc0-01e9-49af-a46d-d9c62166b1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:48 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 Apr 17 16:22:48 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7674ccc0-01e9-49af-a46d-d9c62166b1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0d5023-da36-41fb-b2ce-4d9434f0a48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0d5023-da36-41fb-b2ce-4d9434f0a48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed48195-bb1a-4291-bb7d-d61b97e4c09e', 'volume_name': 'volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc08763-9ef7-49aa-bb1b-fc11592dc4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc08763-9ef7-49aa-bb1b-fc11592dc4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e44d2a9-6e19-47d2-97a8-a5a0a1389452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:48 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume 1ed48195-bb1a-4291-bb7d-d61b97e4c09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e', 'volume_size': 1} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "cinder-76d58ceb-3f7b-456c-a04f-23abd25a8e52-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-76d58ceb-3f7b-456c-a04f-23abd25a8e52-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "cinder-quobyte-76d58ceb-3f7b-456c-a04f-23abd25a8e52" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-quobyte-76d58ceb-3f7b-456c-a04f-23abd25a8e52" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[57246caa-21a9-40e5-808e-16ab9a8da76c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:48 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 Apr 17 16:22:48 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:49 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52" returned: 0 in 0.596s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:49 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 is being set with open permissions: ugo+rw Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:49 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 Apr 17 16:22:49 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:49 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52" returned: 0 in 0.597s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:49 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52 Apr 17 16:22:49 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:49 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52" returned: 0 in 0.501s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:49 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.info Apr 17 16:22:49 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:49 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76d58ceb-3f7b-456c-a04f-23abd25a8e52" returned: 0 in 0.534s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-quobyte-76d58ceb-3f7b-456c-a04f-23abd25a8e52" released by "delete_volume" :: held 1.166s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Created reservations ['6fb50bb8-baae-47b7-a817-42f67e41a707', 'af324c45-2fb2-49c9-8a6f-e0e3be1c8c77', '30e2a571-305b-4b4b-abc8-7e39b882119a', 'd6d2515a-6495-4039-88cf-ca70df46912f'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:49 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:49 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:50 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.info" returned: 0 in 0.455s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:50 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.info is being set with open permissions: ugo+rw Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:50 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.info Apr 17 16:22:50 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:50 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:50 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Deleted volume successfully. Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a563bcd-73ae-4395-b0bc-cf20a485d410 tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-76d58ceb-3f7b-456c-a04f-23abd25a8e52-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:50 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.info" returned: 0 in 0.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-e0ff3245-7c2a-434d-9bcf-53969d637eec" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-e0ff3245-7c2a-434d-9bcf-53969d637eec" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] snapshot: 1e694364-ec36-42a6-9e4b-6a5e7771be52, volume: e0ff3245-7c2a-434d-9bcf-53969d637eec, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6995db5-f99e-4a18-8dce-43013117ae34]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:50 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 Apr 17 16:22:50 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "cinder-f843d0e3-8e11-4673-8a00-b05c60e2796b-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-f843d0e3-8e11-4673-8a00-b05c60e2796b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "cinder-quobyte-f843d0e3-8e11-4673-8a00-b05c60e2796b" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-quobyte-f843d0e3-8e11-4673-8a00-b05c60e2796b" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf341b-942e-4462-8319-5c5fc2d82eae]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:50 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b Apr 17 16:22:50 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Flow 'volume_create_manager' (1053ae10-09ae-4947-af30-3b0770665c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17a129a-8d12-4c9e-98da-cb1170f8e8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17a129a-8d12-4c9e-98da-cb1170f8e8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1402955083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64290073-823e-4188-abd6-21bc8a6cd999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647606b3b7454ec79d61552ae5e51598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:51Z,use_quota=True,user_id='88db3fbacf664a0faaeb80f73c7c2194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2645d6b3-1883-4a35-b0cf-4c72ee03488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2645d6b3-1883-4a35-b0cf-4c72ee03488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:51 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098d736a-083b-4102-976b-d8363eff60dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098d736a-083b-4102-976b-d8363eff60dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64290073-823e-4188-abd6-21bc8a6cd999', 'volume_name': 'volume-64290073-823e-4188-abd6-21bc8a6cd999', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207e3666-673f-4c43-86d3-a42a5e850657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207e3666-673f-4c43-86d3-a42a5e850657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6bdb78d-fdfc-430c-9d3c-ca1e4caed615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:51 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Volume 64290073-823e-4188-abd6-21bc8a6cd999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64290073-823e-4188-abd6-21bc8a6cd999', 'volume_size': 1} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52" returned: 0 in 0.626s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccab9b0-a9ad-406a-a4c1-c2a0a64a137a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:51 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 Apr 17 16:22:51 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:51 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b" returned: 0 in 0.547s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:51 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b Apr 17 16:22:51 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:51 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:51 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec Apr 17 16:22:51 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:51 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f843d0e3-8e11-4673-8a00-b05c60e2796b" returned: 0 in 0.454s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-quobyte-f843d0e3-8e11-4673-8a00-b05c60e2796b" released by "delete_volume" :: held 1.023s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Created reservations ['26478c9e-fc52-4a0e-b3f5-217e72dbbd5f', '37fddb5d-4939-42de-9805-3c28d72c9f44', '1a8146e4-6b07-4ca1-a921-b24aee38f8e4', 'e61c5c7a-8f12-4f2b-b250-ce04a2398506'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:51 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:22:51 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:52 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.540s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:52 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:22:52 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Deleted volume successfully. Apr 17 16:22:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7dbf8084-0d9e-4da1-89f5-364ec26dd79c tempest-ServersNegativeTestJSON-109160360 None] Lock "cinder-f843d0e3-8e11-4673-8a00-b05c60e2796b-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:54 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec" returned: 0 in 2.836s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:54 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[970d240f-64d3-4aad-b6a0-e6c0c56a763a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:54 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 Apr 17 16:22:54 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:55 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" returned: 0 in 0.699s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3, size 1024.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:22:55 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Converted 1024.00 MB image at 360.94 MB/s Apr 17 16:22:55 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec is being set with open permissions: ugo+rw Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:55 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec Apr 17 16:22:55 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:55 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec" returned: 0 in 0.464s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-e0ff3245-7c2a-434d-9bcf-53969d637eec" released by "_copy_volume_from_snapshot" :: held 5.191s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-1e694364-ec36-42a6-9e4b-6a5e7771be52" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-1e694364-ec36-42a6-9e4b-6a5e7771be52" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Deleting offline snapshot 1e694364-ec36-42a6-9e4b-6a5e7771be52 of volume fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] snapshot_file for this snap is: volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f5dce-c038-4f3f-88fd-feee0e39eee5]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:55 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 Apr 17 16:22:55 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:56 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52" returned: 0 in 0.566s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:22:56 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c6fd9-6909-4ed4-89ad-fb89cf458965]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:22:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:56 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 Apr 17 16:22:56 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:56 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" returned: 0 in 0.545s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:56 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 Apr 17 16:22:56 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:57 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52" returned: 0 in 0.504s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:57 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52 Apr 17 16:22:57 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:57 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3.1e694364-ec36-42a6-9e4b-6a5e7771be52" returned: 0 in 0.440s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-1e694364-ec36-42a6-9e4b-6a5e7771be52" released by "_delete_snapshot" :: held 2.123s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.030s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.369s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-804009779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed48195-bb1a-4291-bb7d-d61b97e4c09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:48Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Creating volume 1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:57 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b33f704-2051-44ff-b6a0-cdd77329f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ff3245-7c2a-434d-9bcf-53969d637eec', 'volume_size': 1, 'source_volid': 'fc963bb4-1d36-446a-892d-b8f36cf8c2f3', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86388217-ed83-46c0-a8ba-b80e752330b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:57 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e 1073741824 Apr 17 16:22:57 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:58 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Volume volume-e0ff3245-7c2a-434d-9bcf-53969d637eec (e0ff3245-7c2a-434d-9bcf-53969d637eec): created successfully Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86388217-ed83-46c0-a8ba-b80e752330b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (36e988c9-0941-4cc5-8b9c-91310ae1be69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:58 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-eaa9b7fa-a7a2-4388-aefc-66a982545417 tempest-VolumesGetTest-1751323440 None] Created volume successfully. Apr 17 16:22:58 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e 1073741824" returned: 0 in 0.502s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:58 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e Apr 17 16:22:58 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:58 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" returned: 0 in 0.492s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.745s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1402955083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64290073-823e-4188-abd6-21bc8a6cd999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647606b3b7454ec79d61552ae5e51598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:51Z,use_quota=True,user_id='88db3fbacf664a0faaeb80f73c7c2194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Creating volume 64290073-823e-4188-abd6-21bc8a6cd999 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:22:58 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:22:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e44d2a9-6e19-47d2-97a8-a5a0a1389452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:59 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 1073741824 Apr 17 16:22:59 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f6bdb0-a728-4923-8952-2520d121210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:59 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e (1ed48195-bb1a-4291-bb7d-d61b97e4c09e): created successfully Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f6bdb0-a728-4923-8952-2520d121210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (1cf9bed2-f36b-42ce-afc3-da64874259b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8d089ea2-d22b-4b6c-bfb5-5888efed9628 tempest-VolumesSnapshotTestJSON-2059394780 None] Created volume successfully. Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (fa509e0d-8910-46a1-816b-55375b5684fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae6accc-2bb9-46e5-b3ee-20a96fa18522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae6accc-2bb9-46e5-b3ee-20a96fa18522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-14020783',display_name='tempest-VolumesGetTest-Volume-975391289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab16632-a045-4c3f-a985-8d093b8f0ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:59Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca039932-8250-491b-81e0-dec04f31fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca039932-8250-491b-81e0-dec04f31fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a9d98f-ef3b-48bf-a395-131e98f23ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a9d98f-ef3b-48bf-a395-131e98f23ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab16632-a045-4c3f-a985-8d093b8f0ea8', 'volume_name': 'volume-fab16632-a045-4c3f-a985-8d093b8f0ea8', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16505ec-04f5-4f14-a363-0cd3f300ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16505ec-04f5-4f14-a363-0cd3f300ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82af89f-f007-4784-a5ba-4652227b5ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:22:59 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Volume fab16632-a045-4c3f-a985-8d093b8f0ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab16632-a045-4c3f-a985-8d093b8f0ea8', 'volume_size': 1} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:22:59 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 1073741824" returned: 0 in 0.597s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:22:59 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 Apr 17 16:22:59 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:22:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:00 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999" returned: 0 in 0.502s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:22:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-14020783',display_name='tempest-VolumesGetTest-Volume-975391289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab16632-a045-4c3f-a985-8d093b8f0ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:22:59Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Creating volume fab16632-a045-4c3f-a985-8d093b8f0ea8 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:00 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=104,cinder:UPDATE=133,cinder:DELETE=12,cinder:INSERT=28 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6bdb78d-fdfc-430c-9d3c-ca1e4caed615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64290073-823e-4188-abd6-21bc8a6cd999', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebe157c-1e16-41ab-8f12-b0296610689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=106,cinder:UPDATE=147,cinder:INSERT=35,cinder:DELETE=9 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:23:00 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 1073741824 Apr 17 16:23:00 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:00 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Volume volume-64290073-823e-4188-abd6-21bc8a6cd999 (64290073-823e-4188-abd6-21bc8a6cd999): created successfully Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebe157c-1e16-41ab-8f12-b0296610689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Flow 'volume_create_manager' (1053ae10-09ae-4947-af30-3b0770665c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:00 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6b032ddd-38ae-48d1-b505-13f7bb5866bf tempest-VolumeQuotasNegativeTestJSON-12584463 None] Created volume successfully. Apr 17 16:23:00 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 1073741824" returned: 0 in 0.527s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:00 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 Apr 17 16:23:00 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:01 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8" returned: 0 in 0.491s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.528s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Creating offline snapshot e4eee631-2ba8-423a-909a-e4c6c36d60da of volume 1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82af89f-f007-4784-a5ba-4652227b5ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab16632-a045-4c3f-a985-8d093b8f0ea8', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04502ddc-0985-4dc8-881f-dd149e88ba20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7019d86-1a18-4791-b8a2-5194391943f0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:01 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Volume volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 (fab16632-a045-4c3f-a985-8d093b8f0ea8): created successfully Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04502ddc-0985-4dc8-881f-dd149e88ba20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (fa509e0d-8910-46a1-816b-55375b5684fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:01 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-cd71f39f-f5fb-4e20-b373-9d6eff7fb970 tempest-VolumesGetTest-1751323440 None] Created volume successfully. Apr 17 16:23:01 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e Apr 17 16:23:01 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Acquiring lock "cinder-64290073-823e-4188-abd6-21bc8a6cd999-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "cinder-64290073-823e-4188-abd6-21bc8a6cd999-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Acquiring lock "cinder-quobyte-64290073-823e-4188-abd6-21bc8a6cd999" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "cinder-quobyte-64290073-823e-4188-abd6-21bc8a6cd999" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d78b5-0e5e-4c2a-9669-50d1d9612896]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:01 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" returned: 0 in 0.669s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:01 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 Apr 17 16:23:01 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:01 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da 1G Apr 17 16:23:01 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-fab16632-a045-4c3f-a985-8d093b8f0ea8-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Lock "cinder-fab16632-a045-4c3f-a985-8d093b8f0ea8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:02 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999" returned: 0 in 0.661s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:02 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999 Apr 17 16:23:02 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-fab16632-a045-4c3f-a985-8d093b8f0ea8" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:02 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-fab16632-a045-4c3f-a985-8d093b8f0ea8" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da 1G" returned: 0 in 0.656s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6991f0-4350-43dc-9426-8c8e151c8243]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:02 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da Apr 17 16:23:02 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:02 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 Apr 17 16:23:02 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:03 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-64290073-823e-4188-abd6-21bc8a6cd999" returned: 0 in 0.602s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "cinder-quobyte-64290073-823e-4188-abd6-21bc8a6cd999" released by "delete_volume" :: held 1.296s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:03 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da" returned: 0 in 0.588s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:03 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da is being set with open permissions: ugo+rw Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:03 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da Apr 17 16:23:03 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Created reservations ['1d39b659-6e6c-4242-93fa-a3e61103c494', '5a300670-66be-464d-b297-21498de4089f', '89ca9c19-e257-458f-9a62-f273c2089969', 'fc5282ff-bba3-4499-a7f9-5e820cc7a315'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:03 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8" returned: 0 in 0.696s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:03 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:03 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:03 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8 Apr 17 16:23:03 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:03 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da" returned: 0 in 0.541s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:03 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.info Apr 17 16:23:03 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:03 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.549s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:03 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Deleted volume successfully. Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fab16632-a045-4c3f-a985-8d093b8f0ea8" returned: 0 in 0.555s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-fab16632-a045-4c3f-a985-8d093b8f0ea8" released by "delete_volume" :: held 1.291s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-071ea501-53ef-4852-b1bb-533e325a4c30 tempest-VolumeQuotasNegativeTestJSON-12584463 None] Lock "cinder-64290073-823e-4188-abd6-21bc8a6cd999-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Created reservations ['96c0785c-58c1-438a-ac42-3f1cb673ba35', '208ba6ef-a3b9-40ef-becd-e5c19a55470a', '39a338d8-e32e-4b0a-b6f7-c0f0c38e15e5', 'e1761985-2dd8-4173-b8a6-b2afbb616458'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:03 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:03 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:04 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.info" returned: 0 in 0.575s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:04 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.info is being set with open permissions: ugo+rw Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:04 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.info Apr 17 16:23:04 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:04 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.513s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Deleted volume successfully. Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ae0294c-6a6b-4570-acd4-d70102321f52 tempest-VolumesGetTest-1751323440 None] Lock "cinder-fab16632-a045-4c3f-a985-8d093b8f0ea8-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-e0ff3245-7c2a-434d-9bcf-53969d637eec-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Lock "cinder-e0ff3245-7c2a-434d-9bcf-53969d637eec-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-e0ff3245-7c2a-434d-9bcf-53969d637eec" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:04 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.info" returned: 0 in 0.485s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.602s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-e0ff3245-7c2a-434d-9bcf-53969d637eec" acquired by "delete_volume" :: waited 0.022s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13d9db-4f63-4930-914e-b5ca4100e225]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1e870394-57ab-4e28-a562-70b5f32c46ea tempest-VolumesSnapshotTestJSON-2059394780 None] Create snapshot completed successfully Apr 17 16:23:04 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec Apr 17 16:23:04 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Flow 'volume_create_manager' (4558158b-9032-461b-be9f-7abdc1c0ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f06635-5168-4272-bcb7-7fb1b6ba5630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f06635-5168-4272-bcb7-7fb1b6ba5630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1948838604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46731901-f33c-465c-b5c2-4b4d53dbdb0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f6b041401ec345e28837891f805c01c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:05Z,use_quota=True,user_id='e151b6f95f174a94b2bf7d7b64561118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b70de90-3ec6-4e9e-993c-4f351eb2d0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:05 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b70de90-3ec6-4e9e-993c-4f351eb2d0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be1ec96-ef60-44ed-9af1-c775da3c0821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be1ec96-ef60-44ed-9af1-c775da3c0821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46731901-f33c-465c-b5c2-4b4d53dbdb0f', 'volume_name': 'volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed11e90-718f-42e5-9f0e-5cb86d194b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed11e90-718f-42e5-9f0e-5cb86d194b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92513cfe-7196-4b79-aab8-17d420cf86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:05 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Volume 46731901-f33c-465c-b5c2-4b4d53dbdb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f', 'volume_size': 1} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1948838604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46731901-f33c-465c-b5c2-4b4d53dbdb0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f6b041401ec345e28837891f805c01c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:05Z,use_quota=True,user_id='e151b6f95f174a94b2bf7d7b64561118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Creating volume 46731901-f33c-465c-b5c2-4b4d53dbdb0f {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:05 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec" returned: 0 in 0.712s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:05 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f 1073741824 Apr 17 16:23:05 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:05 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec Apr 17 16:23:05 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-e4eee631-2ba8-423a-909a-e4c6c36d60da-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-e4eee631-2ba8-423a-909a-e4c6c36d60da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:06 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f 1073741824" returned: 0 in 0.636s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-e4eee631-2ba8-423a-909a-e4c6c36d60da" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-e4eee631-2ba8-423a-909a-e4c6c36d60da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:06 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Deleting offline snapshot e4eee631-2ba8-423a-909a-e4c6c36d60da of volume 1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] snapshot_file for this snap is: volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[adddff0f-c125-43bd-8d0d-9154def69884]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e0ff3245-7c2a-434d-9bcf-53969d637eec" returned: 0 in 0.696s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:06 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f Apr 17 16:23:06 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-e0ff3245-7c2a-434d-9bcf-53969d637eec" released by "delete_volume" :: held 1.445s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Created reservations ['6c91adc8-3606-435b-85b4-eaad4443fa35', 'a827c63b-45d7-4cd9-8f22-1bdedb05f1e3', 'edc90404-b157-4fbe-8354-e8de4ea702f3', 'e88fc4fb-f5b8-4290-93f8-56199f98c794'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:06 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da Apr 17 16:23:06 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:06 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:06 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:06 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f" returned: 0 in 0.560s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92513cfe-7196-4b79-aab8-17d420cf86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63570d8-e85b-4556-9eb2-1e9b5cb16106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:06 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Volume volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f (46731901-f33c-465c-b5c2-4b4d53dbdb0f): created successfully Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63570d8-e85b-4556-9eb2-1e9b5cb16106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Flow 'volume_create_manager' (4558158b-9032-461b-be9f-7abdc1c0ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-24381fb8-8744-419f-b78c-c20120f8e781 req-de7a9b40-11b8-47ca-be34-16fecc0f333b tempest-VolumesGetTestJSON-1554253441 None] Created volume successfully. Apr 17 16:23:06 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Deleted volume successfully. Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-33c239f0-a235-4a9b-a15f-3a98b43cde1e tempest-VolumesGetTest-1751323440 None] Lock "cinder-e0ff3245-7c2a-434d-9bcf-53969d637eec-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:06 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da" returned: 0 in 0.779s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52f3dc7-6198-428a-9c1b-ad43fb6b406b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-fc963bb4-1d36-446a-892d-b8f36cf8c2f3-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Lock "cinder-fc963bb4-1d36-446a-892d-b8f36cf8c2f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:07 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e Apr 17 16:23:07 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fcac3d-ac2d-4969-912e-ad23a8ed932c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:07 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 Apr 17 16:23:07 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:07 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" returned: 0 in 0.571s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:07 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da Apr 17 16:23:07 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:07 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" returned: 0 in 0.567s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:07 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3 Apr 17 16:23:07 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Acquiring lock "cinder-46731901-f33c-465c-b5c2-4b4d53dbdb0f-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Lock "cinder-46731901-f33c-465c-b5c2-4b4d53dbdb0f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Acquiring lock "cinder-quobyte-46731901-f33c-465c-b5c2-4b4d53dbdb0f" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Lock "cinder-quobyte-46731901-f33c-465c-b5c2-4b4d53dbdb0f" acquired by "delete_volume" :: waited 0.021s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1333e-9bc0-4fab-a7aa-087993f74a35]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Flow 'volume_create_manager' (7eb68161-5d3d-4e5e-92d4-809820084f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb2aade-1dc2-40c8-8a65-41e9aaef98f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb2aade-1dc2-40c8-8a65-41e9aaef98f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1994404817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64e7af9-4c1b-4035-b704-17eea736628a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9add9e8d9b54226bac342ffb2023335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:08Z,use_quota=True,user_id='9225ad27b39c450d93c1d8f7d957cff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b2a1ecd-a2a6-4448-be42-b7acd4f66baa),volume_type_id=5b2a1ecd-a2a6-4448-be42-b7acd4f66baa)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:08 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f Apr 17 16:23:08 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62da0b6f-3bd9-452d-becf-1cb9e4a471d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62da0b6f-3bd9-452d-becf-1cb9e4a471d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a8c0e7-166d-47dd-b633-2d24ebdd8a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a8c0e7-166d-47dd-b633-2d24ebdd8a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64e7af9-4c1b-4035-b704-17eea736628a', 'volume_name': 'volume-f64e7af9-4c1b-4035-b704-17eea736628a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc3352c-50e7-44cb-9664-dc4d330ad781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc3352c-50e7-44cb-9664-dc4d330ad781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c73b4b6-79d8-4046-a2ff-cbec7c05485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:08 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Volume f64e7af9-4c1b-4035-b704-17eea736628a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64e7af9-4c1b-4035-b704-17eea736628a', 'volume_size': 1} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1994404817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64e7af9-4c1b-4035-b704-17eea736628a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9add9e8d9b54226bac342ffb2023335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:08Z,use_quota=True,user_id='9225ad27b39c450d93c1d8f7d957cff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b2a1ecd-a2a6-4448-be42-b7acd4f66baa),volume_type_id=5b2a1ecd-a2a6-4448-be42-b7acd4f66baa)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Creating volume f64e7af9-4c1b-4035-b704-17eea736628a {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:08 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:08 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da" returned: 0 in 0.566s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:08 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a 1073741824 Apr 17 16:23:08 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:08 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da Apr 17 16:23:08 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:08 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" returned: 0 in 0.627s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-fc963bb4-1d36-446a-892d-b8f36cf8c2f3" released by "delete_volume" :: held 1.234s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Created reservations ['e9230d73-473c-4d08-b9f5-0a58d3165fc0', '68c9b5c8-50f2-47c5-83b2-620bdf1f3edb', 'ca545cd2-587e-4877-b7b1-8f04fb3b0a59', '8c1568f0-09e4-4c83-8b76-895a859a7fde'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:08 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:08 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:08 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f" returned: 0 in 0.577s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:08 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f Apr 17 16:23:08 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:08 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e.e4eee631-2ba8-423a-909a-e4c6c36d60da" returned: 0 in 0.506s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-e4eee631-2ba8-423a-909a-e4c6c36d60da" released by "_delete_snapshot" :: held 2.498s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" released by "delete_snapshot" :: held 2.515s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['0f485e24-33d6-42ba-a80b-875e840b8823', '65abf977-7cbb-4a52-9b33-edebaf62df8b', '439e5ad5-ad28-4e53-a4a0-6845c0949c68', '6a302d66-6725-47d2-8699-b59b72a84b62'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:08 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Delete snapshot completed successfully. Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6d760953-adeb-4bdb-8034-5ea7cc0e1583 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-e4eee631-2ba8-423a-909a-e4c6c36d60da-delete_snapshot" released by "delete_snapshot" :: held 2.652s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:08 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a 1073741824" returned: 0 in 0.651s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:08 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a Apr 17 16:23:08 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:08 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.506s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:08 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Deleted volume successfully. Apr 17 16:23:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55802f9b-25f3-4a70-8ba9-852baa3e116a tempest-VolumesGetTest-1751323440 None] Lock "cinder-fc963bb4-1d36-446a-892d-b8f36cf8c2f3-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:09 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-46731901-f33c-465c-b5c2-4b4d53dbdb0f" returned: 0 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Lock "cinder-quobyte-46731901-f33c-465c-b5c2-4b4d53dbdb0f" released by "delete_volume" :: held 1.120s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.quota [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Created reservations ['39ef06e0-e5e8-4f09-95f0-43906fe784ce', '14cb015d-4867-452e-9934-4ba82ebc0b37', '40b15d51-9676-471f-afe8-d5c91418d004', '2c57c621-2e51-4454-8f0c-c6dad3f93979'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:09 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:09 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:09 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a" returned: 0 in 0.534s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c73b4b6-79d8-4046-a2ff-cbec7c05485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64e7af9-4c1b-4035-b704-17eea736628a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc4b50c-354e-4f15-bbe7-8b7d9db63084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Volume volume-f64e7af9-4c1b-4035-b704-17eea736628a (f64e7af9-4c1b-4035-b704-17eea736628a): created successfully Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc4b50c-354e-4f15-bbe7-8b7d9db63084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Flow 'volume_create_manager' (7eb68161-5d3d-4e5e-92d4-809820084f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ad3cd9c3-662a-4354-8cdb-34746fd0a179 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Created volume successfully. Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (4916316e-1f89-4a78-b352-0b676a914d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42778bfd-c5ff-4edb-af52-c18638545a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42778bfd-c5ff-4edb-af52-c18638545a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-66692663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:10Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cb67ab-ae02-4ae3-a703-cb1dcb147461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cb67ab-ae02-4ae3-a703-cb1dcb147461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b07ad7-e333-44dd-93e6-1d90f415d8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b07ad7-e333-44dd-93e6-1d90f415d8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c', 'volume_name': 'volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7f6172-2107-443e-b809-b5a67436ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7f6172-2107-443e-b809-b5a67436ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b00077-d8ef-4332-b27b-6743152761b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume 0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c', 'volume_size': 1} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-66692663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:10Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Creating volume 0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:09 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.616s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.manager [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:09 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c 1073741824 Apr 17 16:23:09 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Deleted volume successfully. Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [req-f5c2a28c-6553-4772-9a0b-68513a89f669 req-3ec546a7-d3bf-4fa8-88cf-ac1677936e20 tempest-VolumesGetTestJSON-1554253441 None] Lock "cinder-46731901-f33c-465c-b5c2-4b4d53dbdb0f-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (09a1850f-0fdb-4d60-aa12-81c1cc6c0958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aef4c6b-dbd3-4711-9844-10a9baa724c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aef4c6b-dbd3-4711-9844-10a9baa724c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922345671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe34a27-0c69-46aa-a06a-6c1d40b51888,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:10Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3144c0f8-a8c6-4e76-aae2-152b939b833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3144c0f8-a8c6-4e76-aae2-152b939b833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de27ba6-50ee-46ce-b481-8153dcd1cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:09 devstack cinder-volume[82061]: DEBUG cinder.image.glance [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Creating Keystone auth plugin from conf {{(pid=82061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de27ba6-50ee-46ce-b481-8153dcd1cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9fe34a27-0c69-46aa-a06a-6c1d40b51888', 'volume_name': 'volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5fff6b-9583-413b-8c6a-af5902235260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5fff6b-9583-413b-8c6a-af5902235260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1327765-1717-41bc-b71f-faa9f29766e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:10 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Volume 9fe34a27-0c69-46aa-a06a-6c1d40b51888: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Trying to clone 9fe34a27-0c69-46aa-a06a-6c1d40b51888 from image 35106061-d1fb-4b07-851b-6be93771408f at location (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]). {{(pid=82061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 16:23:10 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Image download 20.69 MB at 20.69 MB/s Apr 17 16:23:10 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c 1073741824" returned: 0 in 0.635s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4223be-73f8-4e81-bc5e-9ef7656bd606]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:10 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c Apr 17 16:23:10 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:10 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD Apr 17 16:23:10 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:10 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:10 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:11 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" returned: 0 in 0.564s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b00077-d8ef-4332-b27b-6743152761b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb66e57c-8301-422c-a492-920089779894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:11 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c (0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c): created successfully Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb66e57c-8301-422c-a492-920089779894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (4916316e-1f89-4a78-b352-0b676a914d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:11 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-04d762c9-f5c9-43c4-956f-2150207d1f01 tempest-VolumesSnapshotTestJSON-2059394780 None] Created volume successfully. Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD" returned: 0 in 0.603s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f is fetched for user 6b7ba799cc8b4bfcbe19161de417f044. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f7687-b64f-48b0-9ec1-a61a1aeee374]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:11 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.640s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-cd127190-67fd-496f-bf45-ae531a4b4d78 tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Retype volume completed successfully. Apr 17 16:23:11 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD Apr 17 16:23:11 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:11 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922345671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe34a27-0c69-46aa-a06a-6c1d40b51888,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:10Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Creating volume 9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:11 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:11 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 1073741824 Apr 17 16:23:11 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Acquiring lock "cinder-f64e7af9-4c1b-4035-b704-17eea736628a-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "cinder-f64e7af9-4c1b-4035-b704-17eea736628a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Acquiring lock "cinder-quobyte-f64e7af9-4c1b-4035-b704-17eea736628a" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "cinder-quobyte-f64e7af9-4c1b-4035-b704-17eea736628a" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28de7ee-a637-4345-bdd5-f94aac66e5ad]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:12 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a Apr 17 16:23:12 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:12 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 1073741824" returned: 0 in 0.584s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:12 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 Apr 17 16:23:12 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:12 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a" returned: 0 in 0.646s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:12 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a Apr 17 16:23:12 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:12 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Flow 'volume_create_manager' (bfd27593-285d-4363-a210-9504c452b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cafe611-9918-4e7a-914b-4e4e3ffe9d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888" returned: 0 in 0.500s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.828s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Creating offline snapshot 9d837691-7d33-4bbe-ac6d-284312f94cc8 of volume 0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cafe611-9918-4e7a-914b-4e4e3ffe9d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1091451131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927ff7db-cf71-49eb-a50b-465787dc868b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f094116f436d4bca8a98235cd715ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:13Z,use_quota=True,user_id='26beaa04e89e468e85e4e48c0cd03865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1043a1-b554-4d6e-b72a-7c43529502cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1043a1-b554-4d6e-b72a-7c43529502cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd564656-cdad-42ed-b102-3d70134c529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd564656-cdad-42ed-b102-3d70134c529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927ff7db-cf71-49eb-a50b-465787dc868b', 'volume_name': 'volume-927ff7db-cf71-49eb-a50b-465787dc868b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0cdde-7cc2-481a-936b-0c0bf834fbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0cdde-7cc2-481a-936b-0c0bf834fbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce124f8d-6609-4ae8-a1c6-e10686b1297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:12 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Volume 927ff7db-cf71-49eb-a50b-465787dc868b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927ff7db-cf71-49eb-a50b-465787dc868b', 'volume_size': 1} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cdf67d-d60e-4232-83aa-ba2f26ebd812]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Attempting download of 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume 9fe34a27-0c69-46aa-a06a-6c1d40b51888. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[363de667-abc7-46c1-adb7-9d6583f92a34]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_awk9942t {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:12 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c Apr 17 16:23:12 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:13 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_awk9942t Apr 17 16:23:13 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:13 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f64e7af9-4c1b-4035-b704-17eea736628a" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "cinder-quobyte-f64e7af9-4c1b-4035-b704-17eea736628a" released by "delete_volume" :: held 1.180s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:13 devstack cinder-volume[82061]: WARNING cinder.quota [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:23:13 devstack cinder-volume[82061]: WARNING cinder.quota [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Created reservations ['d868a270-34c4-4ada-a21b-268c0c756b07', '63aa3b32-85f7-461b-a5a6-0f481d529aaf', 'f622b189-e8d8-408e-bb24-0590e8e3c25c', '5270c8e4-c03a-4419-820a-cbe1318b52ca'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:13 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:13 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:13 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" returned: 0 in 0.515s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:13 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 1G Apr 17 16:23:13 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:13 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_awk9942t" returned: 0 in 0.484s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_awk9942t {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:13 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_awk9942t Apr 17 16:23:13 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:13 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.460s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:13 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Deleted volume successfully. Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2c62efa-3c48-442e-8d6d-cdd233ca355d tempest-VolumeRetypeWithoutMigrationTest-1701777293 None] Lock "cinder-f64e7af9-4c1b-4035-b704-17eea736628a-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:13 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 1G" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:13 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 Apr 17 16:23:13 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:13 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_awk9942t" returned: 1 in 0.535s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_awk9942t' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58eeb20-6fd3-4e97-acfd-b26d74d51a5e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:14 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD Apr 17 16:23:14 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:14 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8" returned: 0 in 0.547s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:14 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 is being set with open permissions: ugo+rw Apr 17 16:23:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:14 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 Apr 17 16:23:14 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:14 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:14 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] 35106061-d1fb-4b07-851b-6be93771408f was qcow2, converting to raw {{(pid=82061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 16:23:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:14 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 Apr 17 16:23:14 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:14 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:15 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.info Apr 17 16:23:15 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:15 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.info" returned: 0 in 0.613s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:15 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.info is being set with open permissions: ugo+rw Apr 17 16:23:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:15 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888" returned: 0 in 1.092s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:15 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_0szowewtdevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:23:15 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Converted 112.00 MB image at 102.34 MB/s Apr 17 16:23:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:15 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.info Apr 17 16:23:15 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:15 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 1G Apr 17 16:23:15 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:16 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.info" returned: 0 in 0.463s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1091451131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927ff7db-cf71-49eb-a50b-465787dc868b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f094116f436d4bca8a98235cd715ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:13Z,use_quota=True,user_id='26beaa04e89e468e85e4e48c0cd03865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Creating volume 927ff7db-cf71-49eb-a50b-465787dc868b {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:16 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:16 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b 1073741824 Apr 17 16:23:16 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-bcc73e65-1810-4c20-84c5-0014ef8d918b tempest-VolumesSnapshotTestJSON-2059394780 None] Create snapshot completed successfully Apr 17 16:23:16 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 1G" returned: 0 in 0.567s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[35151f97-9bfa-4e26-b0f8-ce061377af22]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:16 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 Apr 17 16:23:16 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:16 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b 1073741824" returned: 0 in 0.650s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:16 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b Apr 17 16:23:16 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:16 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888" returned: 0 in 0.598s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:16 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 Apr 17 16:23:16 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:17 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b" returned: 0 in 0.581s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce124f8d-6609-4ae8-a1c6-e10686b1297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927ff7db-cf71-49eb-a50b-465787dc868b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800e8941-4f14-4588-a22e-b554c32bfa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:17 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Volume volume-927ff7db-cf71-49eb-a50b-465787dc868b (927ff7db-cf71-49eb-a50b-465787dc868b): created successfully Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800e8941-4f14-4588-a22e-b554c32bfa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Flow 'volume_create_manager' (bfd27593-285d-4363-a210-9504c452b91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d2805140-122f-4d00-b837-c0441188cad7 tempest-VolumesTestJSON-473004481 None] Created volume successfully. Apr 17 16:23:17 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888" returned: 1 in 0.666s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Downloaded image 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume 9fe34a27-0c69-46aa-a06a-6c1d40b51888 successfully. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f for user 6b7ba799cc8b4bfcbe19161de417f044 is deleted. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Marking volume 9fe34a27-0c69-46aa-a06a-6c1d40b51888 as bootable. {{(pid=82061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Copying metadata from image 35106061-d1fb-4b07-851b-6be93771408f to 9fe34a27-0c69-46aa-a06a-6c1d40b51888. {{(pid=82061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Creating volume glance metadata for volume 9fe34a27-0c69-46aa-a06a-6c1d40b51888 backed by image 35106061-d1fb-4b07-851b-6be93771408f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (f289c944-790a-42a7-bf18-4279d5661da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e3c0e8-b696-4bba-bafd-51de8fbdeb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e3c0e8-b696-4bba-bafd-51de8fbdeb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-985082049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fdb7a2-9539-4133-88b4-2e38ea8e8812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9d837691-7d33-4bbe-ac6d-284312f94cc8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:18Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9b58a1-265c-45c1-919d-59bd9ec0ba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9b58a1-265c-45c1-919d-59bd9ec0ba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7691534-2242-4e06-9996-e928828ac766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7691534-2242-4e06-9996-e928828ac766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13fdb7a2-9539-4133-88b4-2e38ea8e8812', 'volume_name': 'volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812', 'volume_size': 2, 'snapshot_id': '9d837691-7d33-4bbe-ac6d-284312f94cc8'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3655d1-48ef-4b99-a66e-d74764abf105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3655d1-48ef-4b99-a66e-d74764abf105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b392c74-a957-4e7b-b1b5-09188d985ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:17 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume 13fdb7a2-9539-4133-88b4-2e38ea8e8812: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812', 'volume_size': 2, 'snapshot_id': '9d837691-7d33-4bbe-ac6d-284312f94cc8'} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-9d837691-7d33-4bbe-ac6d-284312f94cc8-13fdb7a2-9539-4133-88b4-2e38ea8e8812" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1327765-1717-41bc-b71f-faa9f29766e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574b7988-876b-426f-9ea6-eedb330d0398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:17 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Volume volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 (9fe34a27-0c69-46aa-a06a-6c1d40b51888): created successfully Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574b7988-876b-426f-9ea6-eedb330d0398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (09a1850f-0fdb-4d60-aa12-81c1cc6c0958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-9d837691-7d33-4bbe-ac6d-284312f94cc8-13fdb7a2-9539-4133-88b4-2e38ea8e8812" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Creating volume 13fdb7a2-9539-4133-88b4-2e38ea8e8812 from snapshot 9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-13fdb7a2-9539-4133-88b4-2e38ea8e8812" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-897f5e6f-80b3-4228-836d-e54726131a2a tempest-VolumesGetTest-1751323440 None] Created volume successfully. Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-13fdb7a2-9539-4133-88b4-2e38ea8e8812" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] snapshot: 9d837691-7d33-4bbe-ac6d-284312f94cc8, volume: 13fdb7a2-9539-4133-88b4-2e38ea8e8812, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d857fd54-daa8-4e8d-8803-d7de3a56805b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:17 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 Apr 17 16:23:17 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:18 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8" returned: 0 in 0.584s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[099032e6-74d3-4d85-9976-4a0d1fcac2c6]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:18 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c Apr 17 16:23:18 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Flow 'volume_create_manager' (78b95cfd-9576-434e-9b83-2b1981038ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c277854-4a1b-46ea-bb8b-0f1c4a69073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c277854-4a1b-46ea-bb8b-0f1c4a69073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807092623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5a4aa4-ff67-4188-b250-61a04caad388,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f094116f436d4bca8a98235cd715ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:19Z,use_quota=True,user_id='26beaa04e89e468e85e4e48c0cd03865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa41882-c86b-48de-9227-eba945b385d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa41882-c86b-48de-9227-eba945b385d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ab5827-aed5-4735-aa7f-777d97437d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ab5827-aed5-4735-aa7f-777d97437d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5a4aa4-ff67-4188-b250-61a04caad388', 'volume_name': 'volume-1a5a4aa4-ff67-4188-b250-61a04caad388', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84be1670-1bd2-4a17-aa38-7dd4cc43781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84be1670-1bd2-4a17-aa38-7dd4cc43781a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b237bf-f8f7-452e-98ec-fdf08902841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Volume 1a5a4aa4-ff67-4188-b250-61a04caad388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5a4aa4-ff67-4188-b250-61a04caad388', 'volume_size': 1} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (908714ed-fd9d-4977-96f7-f915fde11f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dccde12-d777-45de-8181-3ecfd7ef8a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dccde12-d777-45de-8181-3ecfd7ef8a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-252870705',display_name='tempest-VolumesGetTest-Volume-815819471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bae70d1-7bc5-49c5-a8ad-bbe0281f040e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:19Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9ab4ae-84ee-4dc6-a574-8c50fbbf850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9ab4ae-84ee-4dc6-a574-8c50fbbf850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e9b0a2-460e-49f7-992b-580ea74e08ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e9b0a2-460e-49f7-992b-580ea74e08ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bae70d1-7bc5-49c5-a8ad-bbe0281f040e', 'volume_name': 'volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e4085c-6f67-4ebd-9f08-25872b1246ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e4085c-6f67-4ebd-9f08-25872b1246ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e85d70-3bd4-4c0d-b1a3-ce708ea0abcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Volume 7bae70d1-7bc5-49c5-a8ad-bbe0281f040e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e', 'volume_size': 1} Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:18 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" returned: 0 in 0.676s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:19 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:23:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:19 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 Apr 17 16:23:19 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:21 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812" returned: 0 in 2.485s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:21 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb1711-8c26-48b3-83fc-65f7d8c26783]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:21 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c Apr 17 16:23:21 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:22 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" returned: 0 in 0.635s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:23:22 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Converted 1024.00 MB image at 411.90 MB/s Apr 17 16:23:22 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 is being set with open permissions: ugo+rw Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:22 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 Apr 17 16:23:22 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:22 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812" returned: 0 in 0.411s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-13fdb7a2-9539-4133-88b4-2e38ea8e8812" released by "_copy_volume_from_snapshot" :: held 4.856s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-9d837691-7d33-4bbe-ac6d-284312f94cc8-13fdb7a2-9539-4133-88b4-2e38ea8e8812" released by "_create_volume_from_snapshot" :: held 4.879s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.917s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.780s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807092623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5a4aa4-ff67-4188-b250-61a04caad388,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f094116f436d4bca8a98235cd715ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:19Z,use_quota=True,user_id='26beaa04e89e468e85e4e48c0cd03865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Creating volume 1a5a4aa4-ff67-4188-b250-61a04caad388 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:22 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:22 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 1073741824 Apr 17 16:23:22 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b392c74-a957-4e7b-b1b5-09188d985ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812', 'volume_size': 2, 'snapshot_id': '9d837691-7d33-4bbe-ac6d-284312f94cc8'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276c1592-16c5-4189-81e7-b1c1cdf5ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:22 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Volume volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 (13fdb7a2-9539-4133-88b4-2e38ea8e8812): created successfully Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276c1592-16c5-4189-81e7-b1c1cdf5ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (f289c944-790a-42a7-bf18-4279d5661da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:22 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ec2e189b-6ce3-4c4c-9a02-6dede3cec6c4 tempest-VolumesSnapshotTestJSON-2059394780 None] Created volume successfully. Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-13fdb7a2-9539-4133-88b4-2e38ea8e8812-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-13fdb7a2-9539-4133-88b4-2e38ea8e8812-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-13fdb7a2-9539-4133-88b4-2e38ea8e8812" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-13fdb7a2-9539-4133-88b4-2e38ea8e8812" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:23 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 1073741824" returned: 0 in 0.621s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db10724-f455-4f7d-acd2-b6e1e0c56aca]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:23 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 Apr 17 16:23:23 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:23 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 Apr 17 16:23:23 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:23 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388" returned: 0 in 0.494s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.784s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-252870705',display_name='tempest-VolumesGetTest-Volume-815819471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bae70d1-7bc5-49c5-a8ad-bbe0281f040e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab425a52372149de94dc248b2aa35229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:19Z,use_quota=True,user_id='6b7ba799cc8b4bfcbe19161de417f044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Creating volume 7bae70d1-7bc5-49c5-a8ad-bbe0281f040e {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:23 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b237bf-f8f7-452e-98ec-fdf08902841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5a4aa4-ff67-4188-b250-61a04caad388', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a35f9c5-94f7-4830-82ce-a6b8a80eb059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:23 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e 1073741824 Apr 17 16:23:23 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Volume volume-1a5a4aa4-ff67-4188-b250-61a04caad388 (1a5a4aa4-ff67-4188-b250-61a04caad388): created successfully Apr 17 16:23:23 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a35f9c5-94f7-4830-82ce-a6b8a80eb059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:23 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Flow 'volume_create_manager' (78b95cfd-9576-434e-9b83-2b1981038ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812" returned: 0 in 0.599s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:23 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d258c1fe-ed85-4ef3-bb67-317cf650299a tempest-VolumesTestJSON-473004481 None] Created volume successfully. Apr 17 16:23:23 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812 Apr 17 16:23:23 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:24 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e 1073741824" returned: 0 in 0.665s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:24 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-13fdb7a2-9539-4133-88b4-2e38ea8e8812" returned: 0 in 0.674s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:24 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e Apr 17 16:23:24 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-13fdb7a2-9539-4133-88b4-2e38ea8e8812" released by "delete_volume" :: held 1.326s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['46c674a9-42b3-4657-ac52-6fcae2a1dc66', 'ac051454-cbc6-4130-a0a0-90c89157fca0', '6013d97a-5756-4e7a-ad5a-db1f2cc1ee75', 'cf4d88ec-a98a-4198-9cf2-b9c6f62e1f6f'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Flow 'volume_create_manager' (e0d97f2a-f215-4144-bb64-cb6690718553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c66f7e0-a856-4191-8c8b-2ee51111035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c66f7e0-a856-4191-8c8b-2ee51111035f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1026967903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95386e5b-2b2c-4826-8fda-8f81b706342b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f094116f436d4bca8a98235cd715ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:25Z,use_quota=True,user_id='26beaa04e89e468e85e4e48c0cd03865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e8d7e-0e00-42de-987c-26aaa18e2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e8d7e-0e00-42de-987c-26aaa18e2029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80b6834-cb52-46a4-b1e0-ec56dd0195ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80b6834-cb52-46a4-b1e0-ec56dd0195ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95386e5b-2b2c-4826-8fda-8f81b706342b', 'volume_name': 'volume-95386e5b-2b2c-4826-8fda-8f81b706342b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9abbee-26c3-43f9-86e2-c6b1194b1663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9abbee-26c3-43f9-86e2-c6b1194b1663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f441cc-c140-4165-b2cd-e98e11265c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:24 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Volume 95386e5b-2b2c-4826-8fda-8f81b706342b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95386e5b-2b2c-4826-8fda-8f81b706342b', 'volume_size': 1} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:24 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:24 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:24 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e" returned: 0 in 0.552s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1026967903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95386e5b-2b2c-4826-8fda-8f81b706342b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f094116f436d4bca8a98235cd715ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:25Z,use_quota=True,user_id='26beaa04e89e468e85e4e48c0cd03865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Creating volume 95386e5b-2b2c-4826-8fda-8f81b706342b {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:25 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e85d70-3bd4-4c0d-b1a3-ce708ea0abcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac8bf2-7236-4cca-97f6-1e426ad53f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:25 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b 1073741824 Apr 17 16:23:25 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:25 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Volume volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e (7bae70d1-7bc5-49c5-a8ad-bbe0281f040e): created successfully Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac8bf2-7236-4cca-97f6-1e426ad53f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Flow 'volume_create_manager' (908714ed-fd9d-4977-96f7-f915fde11f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-bedb699d-84d6-49ac-9a40-7db47679b211 tempest-VolumesGetTest-1751323440 None] Created volume successfully. Apr 17 16:23:25 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Deleted volume successfully. Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8c2b3284-1aac-4b92-a874-260e501b2736 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-13fdb7a2-9539-4133-88b4-2e38ea8e8812-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-9d837691-7d33-4bbe-ac6d-284312f94cc8-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-9d837691-7d33-4bbe-ac6d-284312f94cc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-9d837691-7d33-4bbe-ac6d-284312f94cc8" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-9d837691-7d33-4bbe-ac6d-284312f94cc8" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Deleting offline snapshot 9d837691-7d33-4bbe-ac6d-284312f94cc8 of volume 0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] snapshot_file for this snap is: volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d0f98-d869-41a2-a986-fb3e625f31a4]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:25 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 Apr 17 16:23:25 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:25 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b 1073741824" returned: 0 in 0.630s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:25 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b Apr 17 16:23:25 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Lock "cinder-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5268109c-58bf-4124-9e5d-2640154dbad3]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:25 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e Apr 17 16:23:25 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:26 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8" returned: 0 in 0.618s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[94446427-52c9-430b-90b5-14c260a4c8ee]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:26 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c Apr 17 16:23:26 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:26 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b" returned: 0 in 0.615s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f441cc-c140-4165-b2cd-e98e11265c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95386e5b-2b2c-4826-8fda-8f81b706342b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1edbfa-435f-4e9f-9e8d-48add8353479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:26 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Volume volume-95386e5b-2b2c-4826-8fda-8f81b706342b (95386e5b-2b2c-4826-8fda-8f81b706342b): created successfully Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1edbfa-435f-4e9f-9e8d-48add8353479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Flow 'volume_create_manager' (e0d97f2a-f215-4144-bb64-cb6690718553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:26 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-043dc540-23c8-45b6-a0b6-d476f996c89f tempest-VolumesTestJSON-473004481 None] Created volume successfully. Apr 17 16:23:26 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e" returned: 0 in 0.682s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:26 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e Apr 17 16:23:26 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:26 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" returned: 0 in 0.718s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:26 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 Apr 17 16:23:26 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:27 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e" returned: 0 in 0.513s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e" released by "delete_volume" :: held 1.236s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Created reservations ['a0265855-ce25-467b-a120-f62dafa6ddb9', 'e92cab3f-267c-4491-80d9-7c111c1386ae', 'd6003e1d-9550-4e59-88e5-2e89bc79ae3e', '079d8f9f-0021-421d-9541-d799c03ef548'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:27 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:27 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Acquiring lock "cinder-95386e5b-2b2c-4826-8fda-8f81b706342b-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Lock "cinder-95386e5b-2b2c-4826-8fda-8f81b706342b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:27 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Acquiring lock "cinder-quobyte-95386e5b-2b2c-4826-8fda-8f81b706342b" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8" returned: 0 in 0.631s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Lock "cinder-quobyte-95386e5b-2b2c-4826-8fda-8f81b706342b" acquired by "delete_volume" :: waited 0.029s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5585fef8-b1ae-465e-980b-fb96363bbe2c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:27 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8 Apr 17 16:23:27 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:27 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b Apr 17 16:23:27 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:27 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.603s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:27 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Deleted volume successfully. Apr 17 16:23:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0d6e498b-bfe0-4916-8b2b-c3f06ba060d4 tempest-VolumesGetTest-1751323440 None] Lock "cinder-7bae70d1-7bc5-49c5-a8ad-bbe0281f040e-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-9fe34a27-0c69-46aa-a06a-6c1d40b51888-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Lock "cinder-9fe34a27-0c69-46aa-a06a-6c1d40b51888-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:28 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c.9d837691-7d33-4bbe-ac6d-284312f94cc8" returned: 0 in 0.568s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Acquiring lock "cinder-quobyte-9fe34a27-0c69-46aa-a06a-6c1d40b51888" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-9d837691-7d33-4bbe-ac6d-284312f94cc8" released by "_delete_snapshot" :: held 2.649s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" released by "delete_snapshot" :: held 2.670s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-9fe34a27-0c69-46aa-a06a-6c1d40b51888" acquired by "delete_volume" :: waited 0.040s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:28 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[09609cad-717e-4c39-ad9f-55d5c7cf2717]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b" returned: 0 in 0.641s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:28 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b Apr 17 16:23:28 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['6b9b1f4c-9826-4821-a7bb-e98ffdc4df15', '64c2ac16-9b84-413d-b811-80ae6e5e9106', 'c80a0174-a50f-49cf-b193-620c36b32433', 'cf89d981-993c-4c96-8574-49cdb63cb17d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:28 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 Apr 17 16:23:28 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:28 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Delete snapshot completed successfully. Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3df04176-d489-4ef6-a329-dea0d1fc3a85 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-9d837691-7d33-4bbe-ac6d-284312f94cc8-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b129707-0ecc-4d27-8f1d-2de7eee834bb]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:28 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-95386e5b-2b2c-4826-8fda-8f81b706342b" returned: 0 in 0.556s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Lock "cinder-quobyte-95386e5b-2b2c-4826-8fda-8f81b706342b" released by "delete_volume" :: held 1.245s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:28 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888" returned: 0 in 0.623s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Created reservations ['7f799745-0591-434f-8deb-86d11d7fe90d', 'b691ee1c-ae5b-458b-baa2-ee8974887551', 'b741fd14-b9a0-41e1-a949-6b2c55185616', 'd97c4db1-1ad8-4712-a57d-3f114376aad4'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:28 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c Apr 17 16:23:28 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:28 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:28 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:28 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 Apr 17 16:23:28 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:29 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" returned: 0 in 0.591s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:29 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c Apr 17 16:23:29 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:29 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888" returned: 1 in 0.587s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:29 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888 Apr 17 16:23:29 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:29 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.621s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:29 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Deleted volume successfully. Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aecf327c-dc80-4e3b-864a-5332e1daa3b8 tempest-VolumesTestJSON-473004481 None] Lock "cinder-95386e5b-2b2c-4826-8fda-8f81b706342b-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Acquiring lock "cinder-1a5a4aa4-ff67-4188-b250-61a04caad388-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Lock "cinder-1a5a4aa4-ff67-4188-b250-61a04caad388-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Acquiring lock "cinder-quobyte-1a5a4aa4-ff67-4188-b250-61a04caad388" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Lock "cinder-quobyte-1a5a4aa4-ff67-4188-b250-61a04caad388" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c631a-aed4-4d45-8a2d-560e5bf5c46f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:29 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 Apr 17 16:23:29 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:29 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" returned: 0 in 0.520s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c" released by "delete_volume" :: held 1.147s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['808d3210-e865-4c1c-b70f-45230a87cb12', 'b0cc3de7-1920-45f4-b9fd-4bc9db0e65d8', '7d1d28cf-b5aa-4abc-96c2-9d2e21763e57', 'd0d361d9-3e65-460e-ae00-34d484ecf2f4'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:29 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:29 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:30 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fe34a27-0c69-46aa-a06a-6c1d40b51888" returned: 0 in 0.643s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Lock "cinder-quobyte-9fe34a27-0c69-46aa-a06a-6c1d40b51888" released by "delete_volume" :: held 1.907s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Created reservations ['13b13687-3806-44bd-b450-2ba828dbe14f', '127a11f1-7567-4adc-8e2b-a9925737cb32', 'aeb4bf2a-5571-4724-a2b4-8a8d467145e9', 'fe30e0fd-70c3-4345-bcd6-615a6c5159cd'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:30 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:30 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:30 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388" returned: 0 in 0.714s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:30 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388 Apr 17 16:23:30 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:30 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.520s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:30 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Deleted volume successfully. Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a54b6e85-c8ff-4ced-bca2-fa67ce8734a2 tempest-VolumesGetTest-1751323440 None] Lock "cinder-9fe34a27-0c69-46aa-a06a-6c1d40b51888-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:30 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.760s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:30 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Deleted volume successfully. Apr 17 16:23:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58bba508-2aba-4958-a787-4fae630bd44c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-0b5c56ad-af7c-4dd5-82d3-4c43d3afb84c-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:31 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1a5a4aa4-ff67-4188-b250-61a04caad388" returned: 0 in 0.631s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Lock "cinder-quobyte-1a5a4aa4-ff67-4188-b250-61a04caad388" released by "delete_volume" :: held 1.377s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Created reservations ['51be655e-d41b-45ae-9ecd-468c5826ef41', '5c9444ec-836f-414d-97e4-ab857e2d0202', '77cd540d-d570-4fde-b5ae-a29f0a07b2fc', '47c7c0fb-be20-48e4-bc1b-199867a2b39b'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:31 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:31 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (842dc7b5-9daf-4e32-b72c-7430090309c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df65d766-d2db-4873-9737-d5f746729a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df65d766-d2db-4873-9737-d5f746729a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-308788912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aa4be7-b443-4a43-b03e-9f0b4344d9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:31Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533e86f8-a5e6-4fa6-b899-4196a816b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533e86f8-a5e6-4fa6-b899-4196a816b122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc8a5d3-0a1e-46b3-b796-3720c90bd501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc8a5d3-0a1e-46b3-b796-3720c90bd501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6aa4be7-b443-4a43-b03e-9f0b4344d9cd', 'volume_name': 'volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d884f72-7ae0-489b-b74c-5a3db8be7b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d884f72-7ae0-489b-b74c-5a3db8be7b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8a5a17-1d4f-44cb-ba28-7e3732515957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:31 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Volume b6aa4be7-b443-4a43-b03e-9f0b4344d9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd', 'volume_size': 1} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-308788912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aa4be7-b443-4a43-b03e-9f0b4344d9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:31Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Creating volume b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:31 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:31 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd 1073741824 Apr 17 16:23:31 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Acquiring lock "cinder-927ff7db-cf71-49eb-a50b-465787dc868b-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Lock "cinder-927ff7db-cf71-49eb-a50b-465787dc868b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:32 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.774s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:32 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Deleted volume successfully. Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Acquiring lock "cinder-quobyte-927ff7db-cf71-49eb-a50b-465787dc868b" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Lock "cinder-quobyte-927ff7db-cf71-49eb-a50b-465787dc868b" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-20abf1bf-ba2e-48a6-a027-486695f47b4e tempest-VolumesTestJSON-473004481 None] Lock "cinder-1a5a4aa4-ff67-4188-b250-61a04caad388-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ba3a57-99ce-4e3a-950b-9c9e54fc136f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:32 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b Apr 17 16:23:32 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:32 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd 1073741824" returned: 0 in 1.058s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:32 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd Apr 17 16:23:32 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:32 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b" returned: 0 in 0.863s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:33 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b Apr 17 16:23:33 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Flow 'volume_create_manager' (ed928fd8-11ce-4daf-bc94-2cff776aab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c5be51-2bcc-4dfa-a8a8-ec8c38abad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c5be51-2bcc-4dfa-a8a8-ec8c38abad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1183269895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16db1297-c579-49f7-b300-28739b815ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e33d3982a9c641ed965d323086e6ca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:33Z,use_quota=True,user_id='70f0ebba1661478a8c1c5d988efb0165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261776d6-9dbe-40d6-b9fd-4c13c1617bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261776d6-9dbe-40d6-b9fd-4c13c1617bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3dac14-296c-4427-9358-e4c7d09f6795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3dac14-296c-4427-9358-e4c7d09f6795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16db1297-c579-49f7-b300-28739b815ffe', 'volume_name': 'volume-16db1297-c579-49f7-b300-28739b815ffe', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0c2200-cf5b-4eeb-96ac-041e754eaf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0c2200-cf5b-4eeb-96ac-041e754eaf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa562245-ce64-4e19-b288-9e7a59548803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Volume 16db1297-c579-49f7-b300-28739b815ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16db1297-c579-49f7-b300-28739b815ffe', 'volume_size': 1} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:33 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" returned: 0 in 0.668s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1183269895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16db1297-c579-49f7-b300-28739b815ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e33d3982a9c641ed965d323086e6ca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:33Z,use_quota=True,user_id='70f0ebba1661478a8c1c5d988efb0165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Creating volume 16db1297-c579-49f7-b300-28739b815ffe {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:33 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8a5a17-1d4f-44cb-ba28-7e3732515957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b8793-2d64-4fd2-b0cc-6bfe5e7b191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:33 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe 1073741824 Apr 17 16:23:33 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Volume volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd (b6aa4be7-b443-4a43-b03e-9f0b4344d9cd): created successfully Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b8793-2d64-4fd2-b0cc-6bfe5e7b191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (842dc7b5-9daf-4e32-b72c-7430090309c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-61770b8c-f911-44ef-9914-c2d085c8acab tempest-VolumesSnapshotTestJSON-2059394780 None] Created volume successfully. Apr 17 16:23:33 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-927ff7db-cf71-49eb-a50b-465787dc868b" returned: 0 in 0.631s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Lock "cinder-quobyte-927ff7db-cf71-49eb-a50b-465787dc868b" released by "delete_volume" :: held 1.538s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Created reservations ['91eb4a64-1ed7-4508-a388-e04577ee162f', 'c149951d-6756-4cb2-9899-7a6d7242d750', '152207fb-af69-4425-a1e2-c4ab214d136e', '246178c8-84cd-4d1f-98dd-a3f5d34d4f3d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:33 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:33 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:33 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:33 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:33 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe 1073741824" returned: 0 in 0.705s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:34 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe Apr 17 16:23:34 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:34 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.593s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:34 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.614s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:34 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Deleted volume successfully. Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9d68c05d-f61b-4dc6-a993-62ed565ef04f tempest-VolumesTestJSON-473004481 None] Lock "cinder-927ff7db-cf71-49eb-a50b-465787dc868b-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:34 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe" returned: 0 in 0.620s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.848s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa562245-ce64-4e19-b288-9e7a59548803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16db1297-c579-49f7-b300-28739b815ffe', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7364984-236a-4f2e-88d8-e062a61d517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Creating offline snapshot 821cc00f-9abb-4aac-90d2-2b4518650262 of volume b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:23:34 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Volume volume-16db1297-c579-49f7-b300-28739b815ffe (16db1297-c579-49f7-b300-28739b815ffe): created successfully Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7364984-236a-4f2e-88d8-e062a61d517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Flow 'volume_create_manager' (ed928fd8-11ce-4daf-bc94-2cff776aab39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e8f1ee-4486-4cc4-8bd3-b6d68324c60c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:34 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-eec48c62-f8b1-4cf8-ac94-9ea7e38fd770 tempest-VolumesNegativeTest-1541575068 None] Created volume successfully. Apr 17 16:23:34 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd Apr 17 16:23:34 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:35 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" returned: 0 in 0.614s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:35 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 1G Apr 17 16:23:35 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:36 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 1G" returned: 0 in 0.715s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:36 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 Apr 17 16:23:36 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:36 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262" returned: 0 in 0.581s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:36 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 is being set with open permissions: ugo+rw Apr 17 16:23:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:36 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 Apr 17 16:23:36 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:37 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262" returned: 0 in 0.598s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:37 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.info Apr 17 16:23:37 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b0761a2c-1e8a-42c5-88cf-acda80820865 tempest-GroupSnapshotsV319Test-1220533045 None] Group tempest-GroupSnapshotsV319Test-Group-1524793185: creating Apr 17 16:23:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b0761a2c-1e8a-42c5-88cf-acda80820865 tempest-GroupSnapshotsV319Test-1220533045 None] Group tempest-GroupSnapshotsV319Test-Group-1524793185: created successfully Apr 17 16:23:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b0761a2c-1e8a-42c5-88cf-acda80820865 tempest-GroupSnapshotsV319Test-1220533045 None] Create group completed successfully. Apr 17 16:23:37 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.info" returned: 0 in 0.494s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:37 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.info is being set with open permissions: ugo+rw Apr 17 16:23:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:37 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.info Apr 17 16:23:37 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:38 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.info" returned: 0 in 0.446s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.547s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:38 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-05ac1aaa-87d3-4677-812f-5f1e8b949205 tempest-VolumesSnapshotTestJSON-2059394780 None] Create snapshot completed successfully Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Flow 'volume_create_manager' (08984369-0d76-456b-8a2e-a20c0ccf4233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96119d1e-df30-4a66-9a97-d169bfb0c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96119d1e-df30-4a66-9a97-d169bfb0c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-94171994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4f61df1-fe7e-46c7-8801-485296cac41a,host='devstack@QuobyteHD#QuobyteHD',id=3aaf3e52-3188-44c6-8c99-e2afdd7679fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db8c5b042e7c4b57be9f79488dc91686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:39Z,use_quota=True,user_id='26c22f1aa1c4480b87f5692bd2261fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7c9b47d-12a8-4da6-a8b5-e2fcede88f9c),volume_type_id=e7c9b47d-12a8-4da6-a8b5-e2fcede88f9c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a326c8ee-3b67-438c-b044-7f2cc4e2d320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a326c8ee-3b67-438c-b044-7f2cc4e2d320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ce7d66-176e-4c15-af79-4d3c8e8d212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ce7d66-176e-4c15-af79-4d3c8e8d212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aaf3e52-3188-44c6-8c99-e2afdd7679fd', 'volume_name': 'volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dbc737-d1ef-4dd4-93ec-6985909a5d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dbc737-d1ef-4dd4-93ec-6985909a5d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7466a14-485a-4d3f-a56e-6672bb79d21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Volume 3aaf3e52-3188-44c6-8c99-e2afdd7679fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd', 'volume_size': 1} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4f61df1-fe7e-46c7-8801-485296cac41a,created_at=2026-04-17T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-94171994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4f61df1-fe7e-46c7-8801-485296cac41a,host='devstack@QuobyteHD#QuobyteHD',id=3aaf3e52-3188-44c6-8c99-e2afdd7679fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db8c5b042e7c4b57be9f79488dc91686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:39Z,use_quota=True,user_id='26c22f1aa1c4480b87f5692bd2261fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7c9b47d-12a8-4da6-a8b5-e2fcede88f9c),volume_type_id=e7c9b47d-12a8-4da6-a8b5-e2fcede88f9c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Creating volume 3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:38 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:38 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd 1073741824 Apr 17 16:23:38 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (167581d8-34dc-4887-985d-f149eb872a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5edd9f2-98c0-41b7-91af-8523bbe12166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5edd9f2-98c0-41b7-91af-8523bbe12166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-897592135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad478456-cbc7-4c72-82c4-70bde1a7d9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b48280b859c4db7b1a7e43143442571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=821cc00f-9abb-4aac-90d2-2b4518650262,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:39Z,use_quota=True,user_id='9d11aa760a224475aa04299926dbf86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2691f8a-c393-4a28-9a67-94f9f903ddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2691f8a-c393-4a28-9a67-94f9f903ddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb171f0-5852-4722-b944-0281fb6f7403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb171f0-5852-4722-b944-0281fb6f7403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad478456-cbc7-4c72-82c4-70bde1a7d9a9', 'volume_name': 'volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9', 'volume_size': 1, 'snapshot_id': '821cc00f-9abb-4aac-90d2-2b4518650262'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d89028d-e59b-4848-8f49-0cd56d8ac5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d89028d-e59b-4848-8f49-0cd56d8ac5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7ce1ae-a54c-434d-87d1-672c04f7fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:39 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Volume ad478456-cbc7-4c72-82c4-70bde1a7d9a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9', 'volume_size': 1, 'snapshot_id': '821cc00f-9abb-4aac-90d2-2b4518650262'} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:39 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd 1073741824" returned: 0 in 0.598s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:39 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd Apr 17 16:23:39 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:39 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.577s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-821cc00f-9abb-4aac-90d2-2b4518650262-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7466a14-485a-4d3f-a56e-6672bb79d21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e56c11-0a3a-4901-8be1-029722f7ff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:39 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Volume volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd (3aaf3e52-3188-44c6-8c99-e2afdd7679fd): created successfully Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e56c11-0a3a-4901-8be1-029722f7ff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Flow 'volume_create_manager' (08984369-0d76-456b-8a2e-a20c0ccf4233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-821cc00f-9abb-4aac-90d2-2b4518650262-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Creating volume ad478456-cbc7-4c72-82c4-70bde1a7d9a9 from snapshot 821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:39 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2c32c784-5e2a-494e-9493-4d4e715491de tempest-GroupSnapshotsV319Test-1220533045 None] Created volume successfully. Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] snapshot: 821cc00f-9abb-4aac-90d2-2b4518650262, volume: ad478456-cbc7-4c72-82c4-70bde1a7d9a9, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9634ad3a-86a9-4a46-b0c5-1310829be21b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:40 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 Apr 17 16:23:40 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:40 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262" returned: 0 in 0.540s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeee2ae4-e318-4887-ba67-08f6f0e87f35]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:40 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd Apr 17 16:23:40 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] GroupSnapshot 3188b8ca-8a7e-41ae-84ce-08efd257bd24: creating. Apr 17 16:23:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Group snapshot 3188b8ca-8a7e-41ae-84ce-08efd257bd24: creating. {{(pid=82061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 16:23:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:41 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" returned: 0 in 0.629s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:41 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:23:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:41 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 Apr 17 16:23:41 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:43 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" returned: 0 in 2.689s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:43 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1387278-7f5a-4201-b8af-5b83cdd5a9fc]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:43 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd Apr 17 16:23:43 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:44 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" returned: 0 in 0.814s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:44 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd, size 1024.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:23:44 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Converted 1024.00 MB image at 379.50 MB/s Apr 17 16:23:44 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 is being set with open permissions: ugo+rw Apr 17 16:23:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:44 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 Apr 17 16:23:44 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:45 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" returned: 0 in 0.485s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" released by "_copy_volume_from_snapshot" :: held 5.230s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-821cc00f-9abb-4aac-90d2-2b4518650262-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" released by "_create_volume_from_snapshot" :: held 5.250s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.286s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.044s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Creating offline snapshot ed99825f-0d33-4d3b-a57c-46ea3d8f084a of volume 3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7ce1ae-a54c-434d-87d1-672c04f7fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9', 'volume_size': 1, 'snapshot_id': '821cc00f-9abb-4aac-90d2-2b4518650262'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a905961c-51d0-4979-8fad-f28001ff43bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cccfc67-3a27-4b0d-8f58-ea5f50b01fb1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:45 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Volume volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 (ad478456-cbc7-4c72-82c4-70bde1a7d9a9): created successfully Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a905961c-51d0-4979-8fad-f28001ff43bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Flow 'volume_create_manager' (167581d8-34dc-4887-985d-f149eb872a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:45 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-68369479-a979-471c-bc90-c272a72528bd tempest-VolumesSnapshotTestJSON-2059394780 None] Created volume successfully. Apr 17 16:23:45 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd Apr 17 16:23:45 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-ad478456-cbc7-4c72-82c4-70bde1a7d9a9-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-ad478456-cbc7-4c72-82c4-70bde1a7d9a9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad80c5f-61c6-474f-b963-28fa52daed2b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:45 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" returned: 0 in 0.582s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:45 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a 1G Apr 17 16:23:45 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:45 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 Apr 17 16:23:45 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:46 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" returned: 0 in 0.542s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:46 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a 1G" returned: 0 in 0.519s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:46 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9 Apr 17 16:23:46 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:46 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a Apr 17 16:23:46 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:46 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" returned: 0 in 0.527s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-ad478456-cbc7-4c72-82c4-70bde1a7d9a9" released by "delete_volume" :: held 1.096s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:46 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a" returned: 0 in 0.550s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:46 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:46 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a Apr 17 16:23:46 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:46 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['f72db3eb-728b-4f2e-bcbd-067766ebd52d', '1dd67eff-ea8f-4790-a80f-a97cc5d2f4ab', '120089db-16a1-40c1-8876-6246a855dd21', 'd29ebeb7-98eb-4a67-8b75-92ca5ae1ccde'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:47 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:47 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:47 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:47 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.info Apr 17 16:23:47 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:47 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.473s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:47 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Deleted volume successfully. Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ea70723-4d21-4ca9-82ce-abc38a420d9c tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-ad478456-cbc7-4c72-82c4-70bde1a7d9a9-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:47 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.info" returned: 0 in 0.519s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:47 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 16:23:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:47 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.info Apr 17 16:23:47 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-821cc00f-9abb-4aac-90d2-2b4518650262-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-821cc00f-9abb-4aac-90d2-2b4518650262-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-821cc00f-9abb-4aac-90d2-2b4518650262" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-821cc00f-9abb-4aac-90d2-2b4518650262" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Deleting offline snapshot 821cc00f-9abb-4aac-90d2-2b4518650262 of volume b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] snapshot_file for this snap is: volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1187c95-62fd-47af-9e97-5f6e49751a96]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:48 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 Apr 17 16:23:48 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:48 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.info" returned: 0 in 0.475s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:48 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-83d03cc1-5218-4c4c-8b2f-34fc9bbf56fd tempest-GroupSnapshotsV319Test-1220533045 None] group_snapshot 3188b8ca-8a7e-41ae-84ce-08efd257bd24: created successfully Apr 17 16:23:48 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262" returned: 0 in 0.540s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce248be5-0451-4e9d-908d-d17e4aca3748]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:48 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd Apr 17 16:23:48 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:49 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" returned: 0 in 0.697s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:49 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 Apr 17 16:23:49 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:50 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] group_snapshot 3188b8ca-8a7e-41ae-84ce-08efd257bd24: deleting Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] group_snapshot 3188b8ca-8a7e-41ae-84ce-08efd257bd24: deleting {{(pid=82061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Acquiring lock "cinder-quobyte-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Lock "cinder-quobyte-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Acquiring lock "cinder-quobyte-ed99825f-0d33-4d3b-a57c-46ea3d8f084a" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Lock "cinder-quobyte-ed99825f-0d33-4d3b-a57c-46ea3d8f084a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Deleting offline snapshot ed99825f-0d33-4d3b-a57c-46ea3d8f084a of volume 3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] snapshot_file for this snap is: volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17f697d-a56d-4745-966e-e7b38a01aeea]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:50 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a Apr 17 16:23:50 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:50 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262" returned: 0 in 1.358s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:50 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262 Apr 17 16:23:50 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:51 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a" returned: 0 in 1.030s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb82401a-2816-442a-b336-87ca569f6c28]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:51 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd.821cc00f-9abb-4aac-90d2-2b4518650262" returned: 0 in 0.696s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:51 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd Apr 17 16:23:51 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-821cc00f-9abb-4aac-90d2-2b4518650262" released by "_delete_snapshot" :: held 3.367s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" released by "delete_snapshot" :: held 3.377s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['d5c6d20b-5774-4fc2-a2f9-9307cfbfe3f2', '68024d3d-9f4c-4aba-8099-27244bb1f1d9', '1547008f-face-4cbe-9094-c5eab8a5ef87', '95d89426-949e-4b90-afd2-354f21967347'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:51 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Delete snapshot completed successfully. Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e4c378be-906a-4d13-9766-ebef58185a8f tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-821cc00f-9abb-4aac-90d2-2b4518650262-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:51 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" returned: 0 in 0.725s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:52 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a Apr 17 16:23:52 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1998de09-325b-4c0f-a620-b1f10cf2c0c0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (46e0082a-2b1a-4557-a554-799eb0e850c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d729c950-9b8f-4a60-a4aa-637e9446e42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d729c950-9b8f-4a60-a4aa-637e9446e42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789153874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93e9f99-86de-4f74-aa9b-5230e60540ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:53Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:52 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd Apr 17 16:23:52 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e9abca-3b7c-4b12-baf9-f43fbdfd4468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e9abca-3b7c-4b12-baf9-f43fbdfd4468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0b0625-e7ad-4a2e-bacd-a0f9ebbe5687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0b0625-e7ad-4a2e-bacd-a0f9ebbe5687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93e9f99-86de-4f74-aa9b-5230e60540ae', 'volume_name': 'volume-e93e9f99-86de-4f74-aa9b-5230e60540ae', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b37458a-22c3-4d83-b808-4327f6039e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b37458a-22c3-4d83-b808-4327f6039e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:52 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9f5829-2636-431a-bb9a-26b4f41b0157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:52 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Volume e93e9f99-86de-4f74-aa9b-5230e60540ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93e9f99-86de-4f74-aa9b-5230e60540ae', 'volume_size': 1} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789153874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93e9f99-86de-4f74-aa9b-5230e60540ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:23:53Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Creating volume e93e9f99-86de-4f74-aa9b-5230e60540ae {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:23:52 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a" returned: 0 in 0.979s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:53 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae 1073741824 Apr 17 16:23:53 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:53 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a Apr 17 16:23:53 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:53 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae 1073741824" returned: 0 in 0.773s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:53 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" returned: 0 in 0.981s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:53 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd Apr 17 16:23:53 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:53 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae Apr 17 16:23:53 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:53 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd.ed99825f-0d33-4d3b-a57c-46ea3d8f084a" returned: 0 in 0.906s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:53 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Lock "cinder-quobyte-ed99825f-0d33-4d3b-a57c-46ea3d8f084a" released by "_delete_snapshot" :: held 3.767s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:53 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Lock "cinder-quobyte-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" released by "delete_snapshot" :: held 3.799s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:53 devstack cinder-volume[82061]: WARNING cinder.quota [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1596048165 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1596048165, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:23:53 devstack cinder-volume[82061]: WARNING cinder.quota [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1596048165 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1596048165, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] Created reservations ['28046c4e-c26f-49a2-ae36-101a7bd9067e', 'f7e8bb9d-3744-4e51-9e89-8cecefa71e3e', '94a6d70c-d04a-4b1f-8903-ec97028dd756', '42e21677-a3c7-40bc-b06c-54b5489a885f'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:54 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6b55cabb-11d4-4a5a-8817-62256e942100 tempest-GroupSnapshotsV319Test-1220533045 None] group_snapshot 3188b8ca-8a7e-41ae-84ce-08efd257bd24: deleted successfully Apr 17 16:23:54 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9f5829-2636-431a-bb9a-26b4f41b0157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93e9f99-86de-4f74-aa9b-5230e60540ae', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cc4aee-f2ef-4291-844a-563cf3a26137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:23:54 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" returned: 0 in 0.568s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Volume volume-e93e9f99-86de-4f74-aa9b-5230e60540ae (e93e9f99-86de-4f74-aa9b-5230e60540ae): created successfully Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cc4aee-f2ef-4291-844a-563cf3a26137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (46e0082a-2b1a-4557-a554-799eb0e850c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd" released by "delete_volume" :: held 1.725s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:54 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-117ab266-c6a0-4d5e-9cdc-d7ff55a69b6e tempest-VolumesActionsTest-1729207964 None] Created volume successfully. Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['53458b48-1ade-40f9-9be1-00be27868ab9', '3dad5805-ea18-4191-8bc7-a955950d6178', '330408a3-424a-49b1-b535-8429a832208e', 'f088e62c-71aa-4201-873d-c145442b8c7e'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:54 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:54 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4d1cf5a9-2269-439d-acd1-727fa3d37c6b tempest-VolumesActionsTest-1729207964 None] Acquiring lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae" by "attach_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Acquiring lock "cinder-quobyte-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4d1cf5a9-2269-439d-acd1-727fa3d37c6b tempest-VolumesActionsTest-1729207964 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae" acquired by "attach_volume" :: waited 0.034s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Lock "cinder-quobyte-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" acquired by "delete_volume" :: waited 0.023s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:55 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[90381fe4-2ad5-43f4-95c9-1b433137d143]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.650s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Deleted volume successfully. Apr 17 16:23:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4d1cf5a9-2269-439d-acd1-727fa3d37c6b tempest-VolumesActionsTest-1729207964 None] Attaching volume e93e9f99-86de-4f74-aa9b-5230e60540ae to instance 0d05c014-2011-4444-bd24-e2b64ffcdce9 at mountpoint /dev/vdb on host None. Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1ec88aaf-bff9-4c52-87c2-925cf390b940 tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-b6aa4be7-b443-4a43-b03e-9f0b4344d9cd-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-1ed48195-bb1a-4291-bb7d-d61b97e4c09e-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4d1cf5a9-2269-439d-acd1-727fa3d37c6b tempest-VolumesActionsTest-1729207964 None] Attach volume completed successfully. Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4d1cf5a9-2269-439d-acd1-727fa3d37c6b tempest-VolumesActionsTest-1729207964 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae" released by "attach_volume" :: held 0.139s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:55 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd Apr 17 16:23:55 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-1ed48195-bb1a-4291-bb7d-d61b97e4c09e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "cinder-quobyte-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53fc7ef-fef5-4f6b-b31f-3bc8ec40a931]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:55 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e Apr 17 16:23:55 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:55 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" returned: 0 in 0.598s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:55 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd Apr 17 16:23:55 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:55 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" returned: 0 in 0.553s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:55 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e Apr 17 16:23:55 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-bd9a24b8-d260-4bf0-89e2-16c7ee55993e tempest-VolumesActionsTest-768168808 None] Terminate volume connection completed successfully. Apr 17 16:23:56 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" returned: 0 in 0.549s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Lock "cinder-quobyte-3aaf3e52-3188-44c6-8c99-e2afdd7679fd" released by "delete_volume" :: held 1.195s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:56 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" returned: 0 in 0.497s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-quobyte-1ed48195-bb1a-4291-bb7d-d61b97e4c09e" released by "delete_volume" :: held 1.093s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Created reservations ['2262e0db-1e43-43e0-bb10-914f3ace3789'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:56 devstack cinder-volume[82061]: WARNING cinder.quota [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1596048165 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1596048165, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Created reservations ['e7376dd9-6ee4-495d-b617-4fe78464e6f0', 'd6b7f735-fd39-42c8-bc4c-0badcb9c653d', '83e0e286-469d-46c6-b37e-5608c0223e54', '914103c4-b508-4b97-9ef4-f14fb30b8ddc'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Created reservations ['5ba47019-79ff-4f6f-b0ea-e5e1dea7ca3d', '335520fb-56c8-407d-bf03-12882a13af3e', '60a00bcb-12b0-4f40-b76d-1f5e69b00b39', '828850dd-20c3-40e0-adb0-cc664bc6cb1f'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:56 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:56 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bd9a24b8-d260-4bf0-89e2-16c7ee55993e tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-detach_volume" by "detach_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bd9a24b8-d260-4bf0-89e2-16c7ee55993e tempest-VolumesActionsTest-768168808 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-bd9a24b8-d260-4bf0-89e2-16c7ee55993e tempest-VolumesActionsTest-768168808 None] Detaching volume e93e9f99-86de-4f74-aa9b-5230e60540ae from instance 0d05c014-2011-4444-bd24-e2b64ffcdce9. Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:56 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:56 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-bd9a24b8-d260-4bf0-89e2-16c7ee55993e tempest-VolumesActionsTest-768168808 None] Detach volume completed successfully. Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bd9a24b8-d260-4bf0-89e2-16c7ee55993e tempest-VolumesActionsTest-768168808 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:56 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Deleted volume successfully. Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed52f777-20fe-49c9-97da-ff7de12eb4da tempest-VolumesSnapshotTestJSON-2059394780 None] Lock "cinder-1ed48195-bb1a-4291-bb7d-d61b97e4c09e-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:56 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.457s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:56 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-9e50aa1b-b519-4016-ada8-d57969a880cd tempest-GroupSnapshotsV319Test-1220533045 None] Delete group completed successfully. Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-db24aeb8-6340-4538-8f0e-cda5a8c27b1c tempest-VolumesActionsTest-1729207964 None] Acquiring lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-detach_volume" by "detach_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-db24aeb8-6340-4538-8f0e-cda5a8c27b1c tempest-VolumesActionsTest-1729207964 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:57 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-db24aeb8-6340-4538-8f0e-cda5a8c27b1c tempest-VolumesActionsTest-1729207964 None] Volume detach called, but volume not attached. Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-db24aeb8-6340-4538-8f0e-cda5a8c27b1c tempest-VolumesActionsTest-1729207964 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "cinder-quobyte-e93e9f99-86de-4f74-aa9b-5230e60540ae" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-quobyte-e93e9f99-86de-4f74-aa9b-5230e60540ae" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c73ec01-1030-411b-82e6-245a5ddf18dc]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:23:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:57 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae Apr 17 16:23:57 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:58 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae" returned: 0 in 0.596s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:58 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae Apr 17 16:23:58 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:58 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-e93e9f99-86de-4f74-aa9b-5230e60540ae" returned: 0 in 0.626s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-quobyte-e93e9f99-86de-4f74-aa9b-5230e60540ae" released by "delete_volume" :: held 1.248s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Created reservations ['43bf2d66-1106-4071-840f-bcd5c5eb24f0', '8b6c2efd-62fb-4fdc-a75e-569b8da48037', '39c843be-4f95-44cc-bd51-8425656925f7', '5eefe350-9cf5-481c-a262-ad56d4750bb4'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:23:59 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:23:59 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:23:59 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.548s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:23:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Deleted volume successfully. Apr 17 16:23:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-19cd3fcc-8476-40ed-882d-23c63ef47a33 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-e93e9f99-86de-4f74-aa9b-5230e60540ae-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:UPDATE=224,cinder:DELETE=22,cinder:SELECT=203,cinder:INSERT=58 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:24:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d28c0a40-dbd1-44ac-b9af-dc938225a383 tempest-GroupsTest-1496050001 None] Group tempest-Group1-2118133876: creating Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=185,cinder:UPDATE=235,cinder:DELETE=14,cinder:INSERT=63 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:24:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d28c0a40-dbd1-44ac-b9af-dc938225a383 tempest-GroupsTest-1496050001 None] Group tempest-Group1-2118133876: created successfully Apr 17 16:24:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d28c0a40-dbd1-44ac-b9af-dc938225a383 tempest-GroupsTest-1496050001 None] Create group completed successfully. Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Flow 'volume_create_manager' (ea21921d-6029-43d5-b644-0b80a669af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f233164a-de39-4df6-980d-308fd403b4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f233164a-de39-4df6-980d-308fd403b4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-999636042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8335f3-afd8-4bc9-860b-4d62cb9f1643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31fc91491df94baebd111ddfed3e7d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:03Z,use_quota=True,user_id='b0b56b9743624506a06032fb481d3f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f275e6-617a-4e4c-bff7-343e5ed7b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f275e6-617a-4e4c-bff7-343e5ed7b541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963214f1-e7ef-457c-afd3-768722bcc618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963214f1-e7ef-457c-afd3-768722bcc618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8335f3-afd8-4bc9-860b-4d62cb9f1643', 'volume_name': 'volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22697b75-9e27-476b-8c77-d2fc0ab1683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22697b75-9e27-476b-8c77-d2fc0ab1683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b2f4fc-65de-4e1b-906c-897db49fb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:02 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643', 'volume_size': 1} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-999636042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8335f3-afd8-4bc9-860b-4d62cb9f1643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31fc91491df94baebd111ddfed3e7d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:03Z,use_quota=True,user_id='b0b56b9743624506a06032fb481d3f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Creating volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:02 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:03 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 1073741824 Apr 17 16:24:03 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6a219142-c044-4278-bf1c-edc3637f5364 tempest-GroupsTest-1496050001 None] Group tempest-Group2-545940823: creating Apr 17 16:24:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6a219142-c044-4278-bf1c-edc3637f5364 tempest-GroupsTest-1496050001 None] Group tempest-Group2-545940823: created successfully Apr 17 16:24:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6a219142-c044-4278-bf1c-edc3637f5364 tempest-GroupsTest-1496050001 None] Create group completed successfully. Apr 17 16:24:03 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 1073741824" returned: 0 in 0.613s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:03 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 Apr 17 16:24:03 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:04 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" returned: 0 in 0.519s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b2f4fc-65de-4e1b-906c-897db49fb25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6ee734-6b7c-48c2-8dd0-2ab025c6cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:04 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Volume volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 (5e8335f3-afd8-4bc9-860b-4d62cb9f1643): created successfully Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6ee734-6b7c-48c2-8dd0-2ab025c6cecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Flow 'volume_create_manager' (ea21921d-6029-43d5-b644-0b80a669af15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-bb3c089b-b046-40b1-aa2c-468825bb5833 tempest-VolumesSnapshotListTestJSON-1519553874 None] Created volume successfully. Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Flow 'volume_create_manager' (1a3a73f5-50b2-4dbe-bea5-7e1f5df61e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae282242-2a62-4204-9e9e-67cde80bfe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae282242-2a62-4204-9e9e-67cde80bfe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1146081863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0dc7aff1-cd8a-4549-b496-52ba9227fc37,host='devstack@QuobyteHD#QuobyteHD',id=df7f9db8-9ea6-47e0-8995-b802a1f4b6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c219cf425e464eaf5a999d9dffec57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:05Z,use_quota=True,user_id='b561035089be47fbbd6424b172a060ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb767e2d-ef9f-44d3-a1d7-6d09c7071624),volume_type_id=bb767e2d-ef9f-44d3-a1d7-6d09c7071624)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb60676d-df73-4c7e-a5d3-319ec2c4e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb60676d-df73-4c7e-a5d3-319ec2c4e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e982dc89-04df-40bf-8775-631e718b86fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e982dc89-04df-40bf-8775-631e718b86fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7f9db8-9ea6-47e0-8995-b802a1f4b6f6', 'volume_name': 'volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d15c01e-93ce-4d77-ba3e-a4d578cd6b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d15c01e-93ce-4d77-ba3e-a4d578cd6b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a739ed-efcf-4398-8752-1dea551e122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:04 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Volume df7f9db8-9ea6-47e0-8995-b802a1f4b6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6', 'volume_size': 1} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0dc7aff1-cd8a-4549-b496-52ba9227fc37,created_at=2026-04-17T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1146081863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0dc7aff1-cd8a-4549-b496-52ba9227fc37,host='devstack@QuobyteHD#QuobyteHD',id=df7f9db8-9ea6-47e0-8995-b802a1f4b6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c219cf425e464eaf5a999d9dffec57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:05Z,use_quota=True,user_id='b561035089be47fbbd6424b172a060ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb767e2d-ef9f-44d3-a1d7-6d09c7071624),volume_type_id=bb767e2d-ef9f-44d3-a1d7-6d09c7071624)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Creating volume df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:04 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:04 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 1073741824 Apr 17 16:24:04 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Acquiring lock "cinder-16db1297-c579-49f7-b300-28739b815ffe-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Lock "cinder-16db1297-c579-49f7-b300-28739b815ffe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Acquiring lock "cinder-quobyte-16db1297-c579-49f7-b300-28739b815ffe" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Lock "cinder-quobyte-16db1297-c579-49f7-b300-28739b815ffe" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9ce925-e405-40a7-b86e-246817f60241]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:05 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 1073741824" returned: 0 in 0.646s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:05 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 Apr 17 16:24:05 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:05 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe Apr 17 16:24:05 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:06 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.922s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:06 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a739ed-efcf-4398-8752-1dea551e122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f20f7e-5f77-43ab-a1f2-25bcd9fae9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Creating offline snapshot 86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 of volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe" returned: 0 in 0.567s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a540f2b-60df-4d23-ad4e-446a1fae10c3]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:06 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe Apr 17 16:24:06 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:06 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Volume volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 (df7f9db8-9ea6-47e0-8995-b802a1f4b6f6): created successfully Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f20f7e-5f77-43ab-a1f2-25bcd9fae9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Flow 'volume_create_manager' (1a3a73f5-50b2-4dbe-bea5-7e1f5df61e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-604c00d0-6415-4988-b21c-63a0668e4c93 tempest-GroupsTest-1496050001 None] Created volume successfully. Apr 17 16:24:06 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 Apr 17 16:24:06 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (2b6ae1e7-337d-4477-a925-fc3c27a01405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477e27d-2f71-4363-b594-bba616c416e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:06 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-16db1297-c579-49f7-b300-28739b815ffe" returned: 0 in 0.501s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477e27d-2f71-4363-b594-bba616c416e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945848619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b0b9e9-936b-421e-98b4-7459eb7ba192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:07Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99536fa9-abe0-4fe1-b285-0b92425aa776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99536fa9-abe0-4fe1-b285-0b92425aa776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1335ba53-77fd-4276-94d1-e38a5d26ec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1335ba53-77fd-4276-94d1-e38a5d26ec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b0b9e9-936b-421e-98b4-7459eb7ba192', 'volume_name': 'volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aef5da2-aeb3-42cc-b852-e2305ab4c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aef5da2-aeb3-42cc-b852-e2305ab4c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e81346-e41b-4e7e-901e-5ddf168dc690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:06 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Volume d4b0b9e9-936b-421e-98b4-7459eb7ba192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192', 'volume_size': 1} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Lock "cinder-quobyte-16db1297-c579-49f7-b300-28739b815ffe" released by "delete_volume" :: held 1.130s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Created reservations ['f6083357-a6d0-4750-9e75-6b1b501180f9', '41dd8820-5765-43c7-8185-cf10997cbc28', 'a9aaf869-3977-405d-a802-11f274b3a231', 'b98d0096-771e-4eb2-959c-fddba886ecbe'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:06 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" returned: 0 in 0.572s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:06 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 1G Apr 17 16:24:06 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:06 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:06 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:07 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 1G" returned: 0 in 0.536s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:07 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 Apr 17 16:24:07 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:07 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:07 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Deleted volume successfully. Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-09c7d469-7b6a-4233-9a48-757313ae4019 tempest-VolumesNegativeTest-1541575068 None] Lock "cinder-16db1297-c579-49f7-b300-28739b815ffe-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Acquiring lock "cinder-quobyte-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Lock "cinder-quobyte-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fb690c-2b35-4453-96f9-5671ca5bc61b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:07 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 Apr 17 16:24:07 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:07 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" returned: 0 in 0.506s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:07 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 is being set with open permissions: ugo+rw Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:07 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 Apr 17 16:24:07 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:07 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6" returned: 0 in 0.559s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:08 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6 Apr 17 16:24:08 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:08 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" returned: 0 in 0.458s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:08 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.info Apr 17 16:24:08 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:08 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6" returned: 0 in 0.555s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Lock "cinder-quobyte-df7f9db8-9ea6-47e0-8995-b802a1f4b6f6" released by "delete_volume" :: held 1.136s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Created reservations ['fe10f17f-7647-429b-8d89-b1fcffa44323'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:08 devstack cinder-volume[82061]: WARNING cinder.quota [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1620771438 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1620771438, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:24:08 devstack cinder-volume[82061]: WARNING cinder.quota [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1620771438 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1620771438, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Created reservations ['bdd3d587-4596-4a46-91b7-2731d994e170', 'a494dac9-1485-4dfc-8742-a750f41e4643', '4f397a5c-a011-4ad0-b736-b65141324b0a', 'bd8d2a32-5040-4e5c-b862-5e40ec9d411d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:08 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:08 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:08 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.info" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:08 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.info is being set with open permissions: ugo+rw Apr 17 16:24:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:08 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.info Apr 17 16:24:08 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:09 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (055b850a-3cb6-4ab2-b634-2bde043c2c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c81c44-157a-495a-96b6-23c17df05318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c81c44-157a-495a-96b6-23c17df05318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47295377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63fb74a-7556-424c-a892-5e1e9ae8b20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:09Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3019c6-a442-4df8-b06c-de771fdf3c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3019c6-a442-4df8-b06c-de771fdf3c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6f2e14-85f8-404b-8cc3-d1a0fa814754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:09 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6f2e14-85f8-404b-8cc3-d1a0fa814754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63fb74a-7556-424c-a892-5e1e9ae8b20a', 'volume_name': 'volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b14e331-7296-4b2c-b6c1-0c228f64ed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b14e331-7296-4b2c-b6c1-0c228f64ed0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeae43f-b815-455e-a3c0-8de9fad0bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:09 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume a63fb74a-7556-424c-a892-5e1e9ae8b20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a', 'volume_size': 1} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.info" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.151s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.525s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945848619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b0b9e9-936b-421e-98b4-7459eb7ba192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:07Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Creating volume d4b0b9e9-936b-421e-98b4-7459eb7ba192 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:09 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1a833bb4-bc96-4808-aa09-b53003f12852 tempest-GroupsTest-1496050001 None] Delete group completed successfully. Apr 17 16:24:09 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 1073741824 Apr 17 16:24:09 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-79be83c2-2d2a-4796-9531-ef5760594fbf tempest-VolumesSnapshotListTestJSON-1519553874 None] Create snapshot completed successfully Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Created reservations ['37c38eef-979f-4005-974a-9c40e42ee1d3'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:09 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:09 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:09 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 1073741824" returned: 0 in 0.544s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:09 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 Apr 17 16:24:09 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:10 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.439s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:10 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-23cb1e68-131f-4aa6-81be-817db68449fb tempest-GroupsTest-1496050001 None] Delete group completed successfully. Apr 17 16:24:10 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192" returned: 0 in 0.411s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47295377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63fb74a-7556-424c-a892-5e1e9ae8b20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:09Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Creating volume a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:10 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e81346-e41b-4e7e-901e-5ddf168dc690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:10 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a 1073741824 Apr 17 16:24:10 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db2f949-7a41-4544-9941-31f60d709923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:10 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Volume volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 (d4b0b9e9-936b-421e-98b4-7459eb7ba192): created successfully Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db2f949-7a41-4544-9941-31f60d709923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (2b6ae1e7-337d-4477-a925-fc3c27a01405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:10 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4d1539a3-9c61-445f-b9b0-bb274be18346 tempest-VolumesActionsTest-1729207964 None] Created volume successfully. Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:10 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a 1073741824" returned: 0 in 0.500s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:10 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a Apr 17 16:24:10 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-d4b0b9e9-936b-421e-98b4-7459eb7ba192-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Lock "cinder-d4b0b9e9-936b-421e-98b4-7459eb7ba192-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-quobyte-d4b0b9e9-936b-421e-98b4-7459eb7ba192" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-d4b0b9e9-936b-421e-98b4-7459eb7ba192" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69641f2-7295-42da-ad44-81aac2e7da2e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c25bf967-2acd-466e-a6f8-111688ef9431 tempest-GroupsTest-1496050001 None] Group tempest-GroupsTest-Group-451542436: creating Apr 17 16:24:11 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 Apr 17 16:24:11 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c25bf967-2acd-466e-a6f8-111688ef9431 tempest-GroupsTest-1496050001 None] Group tempest-GroupsTest-Group-451542436: created successfully Apr 17 16:24:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c25bf967-2acd-466e-a6f8-111688ef9431 tempest-GroupsTest-1496050001 None] Create group completed successfully. Apr 17 16:24:11 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.825s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeae43f-b815-455e-a3c0-8de9fad0bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf40b0a-416a-4804-8fb6-5e2fe0600ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Creating offline snapshot e7435d81-bd10-4085-bd06-978890747ece of volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:24:11 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a (a63fb74a-7556-424c-a892-5e1e9ae8b20a): created successfully Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf40b0a-416a-4804-8fb6-5e2fe0600ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (055b850a-3cb6-4ab2-b634-2bde043c2c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c6302-b48e-4936-b586-9f8fc580dff7]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b6e1d97f-47ac-460c-be4f-4934c5b2b9a9 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created volume successfully. Apr 17 16:24:11 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 Apr 17 16:24:11 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:11 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192" returned: 0 in 0.536s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:11 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192 Apr 17 16:24:11 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:11 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" returned: 0 in 0.470s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:11 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece 1G Apr 17 16:24:11 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:11 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d4b0b9e9-936b-421e-98b4-7459eb7ba192" returned: 0 in 0.412s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-d4b0b9e9-936b-421e-98b4-7459eb7ba192" released by "delete_volume" :: held 0.973s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:11 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Created reservations ['c755662e-341e-4284-925f-1eb4bf736487', '878c55a4-8354-4340-a39a-83ffddadf5f6', '66a7f2dc-184d-400a-9209-4ec86c8634af', 'cf7f631f-6c6e-40d9-85c0-acf53672a7dc'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:12 devstack sudo[87268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:12 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:12 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece 1G" returned: 0 in 0.532s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:12 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece Apr 17 16:24:12 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Flow 'volume_create_manager' (ba2e4f59-1191-40c5-a6ab-6227262284b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb557a0-b9a9-4fbf-9e4b-e30cdb08fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb557a0-b9a9-4fbf-9e4b-e30cdb08fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201602200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3152986d-8fb4-4e2e-925f-79d99c43e6a9,host='devstack@QuobyteHD#QuobyteHD',id=5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c219cf425e464eaf5a999d9dffec57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:12Z,use_quota=True,user_id='b561035089be47fbbd6424b172a060ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33cbbcd4-066c-402d-b896-19c4ae7609c3),volume_type_id=33cbbcd4-066c-402d-b896-19c4ae7609c3)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abe5f18-4dde-4cf3-a808-239a06084177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abe5f18-4dde-4cf3-a808-239a06084177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b7e1aa-65f1-454b-9289-0026df59f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b7e1aa-65f1-454b-9289-0026df59f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e', 'volume_name': 'volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d70210-5648-4eeb-bb4c-0b96ca656a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d70210-5648-4eeb-bb4c-0b96ca656a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d6214f-6316-42b6-9eaf-026f7dba8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:12 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Volume 5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e', 'volume_size': 1} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:12 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.544s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:12 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Deleted volume successfully. Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ec8c42d5-d080-431f-ac7d-c64993c57238 tempest-VolumesActionsTest-768168808 None] Lock "cinder-d4b0b9e9-936b-421e-98b4-7459eb7ba192-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:12 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:12 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece is being set with open permissions: ugo+rw Apr 17 16:24:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:12 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece Apr 17 16:24:12 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:13 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece" returned: 0 in 0.438s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3152986d-8fb4-4e2e-925f-79d99c43e6a9,created_at=2026-04-17T14:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201602200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3152986d-8fb4-4e2e-925f-79d99c43e6a9,host='devstack@QuobyteHD#QuobyteHD',id=5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c219cf425e464eaf5a999d9dffec57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:12Z,use_quota=True,user_id='b561035089be47fbbd6424b172a060ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33cbbcd4-066c-402d-b896-19c4ae7609c3),volume_type_id=33cbbcd4-066c-402d-b896-19c4ae7609c3)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Creating volume 5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:13 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:13 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e 1073741824 Apr 17 16:24:13 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:13 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b0f55513-edf1-494d-9602-2719d9267da0 tempest-VolumesSnapshotListTestJSON-1519553874 None] Create snapshot completed successfully Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (fdda3317-7982-4aac-b862-dca782c10e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eafd0d-5e7b-472e-bdf3-d95a939ba145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eafd0d-5e7b-472e-bdf3-d95a939ba145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127358581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d7cb52-91e4-45fa-9180-171f60b9cec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:13Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f08737-9ce7-426b-a99b-b0cd2b54de08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f08737-9ce7-426b-a99b-b0cd2b54de08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8574d9-21a0-4244-8cf1-b90cdd05ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8574d9-21a0-4244-8cf1-b90cdd05ca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d7cb52-91e4-45fa-9180-171f60b9cec7', 'volume_name': 'volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1f77e4-23f6-4b97-9e97-e5185854740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1f77e4-23f6-4b97-9e97-e5185854740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7c9af0-2c96-45f1-ba52-0eb69e25710c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:13 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Volume a9d7cb52-91e4-45fa-9180-171f60b9cec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7', 'volume_size': 1} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:13 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e 1073741824" returned: 0 in 0.545s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:13 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e Apr 17 16:24:13 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:14 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e" returned: 0 in 0.395s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.729s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d6214f-6316-42b6-9eaf-026f7dba8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b6b41e-e1c9-4ed8-9c16-6c1c875c8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Creating offline snapshot fd2279f6-b6e4-44c1-b224-5694cfb6671a of volume a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:24:14 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Volume volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e (5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e): created successfully Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b6b41e-e1c9-4ed8-9c16-6c1c875c8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Flow 'volume_create_manager' (ba2e4f59-1191-40c5-a6ab-6227262284b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc4f94-7a69-44a7-aba1-fa3fff9fe3f6]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-818a2ee3-7b18-4ea6-98e0-68bc283e160d tempest-GroupsTest-1496050001 None] Created volume successfully. Apr 17 16:24:14 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a Apr 17 16:24:14 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:14 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a" returned: 0 in 0.507s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:14 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a 1G Apr 17 16:24:14 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Flow 'volume_create_manager' (fbbb6b39-7896-456b-907b-d8ad1ca2f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0144a66-e083-42aa-9bc7-804bc9cfcb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0144a66-e083-42aa-9bc7-804bc9cfcb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1024441316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3152986d-8fb4-4e2e-925f-79d99c43e6a9,host='devstack@QuobyteHD#QuobyteHD',id=d66700cb-9dc0-4642-9e30-1baef2530105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c219cf425e464eaf5a999d9dffec57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:15Z,use_quota=True,user_id='b561035089be47fbbd6424b172a060ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33cbbcd4-066c-402d-b896-19c4ae7609c3),volume_type_id=33cbbcd4-066c-402d-b896-19c4ae7609c3)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0c5a42-ccfd-4605-a5f8-f5467ea4e5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0c5a42-ccfd-4605-a5f8-f5467ea4e5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dc2f88-2eee-4406-ad56-751a128bd5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dc2f88-2eee-4406-ad56-751a128bd5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66700cb-9dc0-4642-9e30-1baef2530105', 'volume_name': 'volume-d66700cb-9dc0-4642-9e30-1baef2530105', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3183564d-bab5-43f8-a5b1-e60a10747f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3183564d-bab5-43f8-a5b1-e60a10747f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0062c144-27fd-41d8-8a77-ea9294d34f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:14 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Volume d66700cb-9dc0-4642-9e30-1baef2530105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66700cb-9dc0-4642-9e30-1baef2530105', 'volume_size': 1} Apr 17 16:24:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:15 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a 1G" returned: 0 in 0.471s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:15 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a Apr 17 16:24:15 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:15 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a" returned: 0 in 0.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:15 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a is being set with open permissions: ugo+rw Apr 17 16:24:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:15 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a Apr 17 16:24:15 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:16 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a" returned: 0 in 0.425s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:16 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.info Apr 17 16:24:16 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:16 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.info" returned: 0 in 0.458s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:16 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.info is being set with open permissions: ugo+rw Apr 17 16:24:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:16 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.info Apr 17 16:24:16 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:17 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.info" returned: 0 in 0.446s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.625s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127358581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d7cb52-91e4-45fa-9180-171f60b9cec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:13Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Creating volume a9d7cb52-91e4-45fa-9180-171f60b9cec7 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:17 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:17 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 1073741824 Apr 17 16:24:17 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-20255d0a-f254-4d6e-988b-166769ee687d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Create snapshot completed successfully Apr 17 16:24:17 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 1073741824" returned: 0 in 0.527s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:17 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 Apr 17 16:24:17 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (db5f0ccb-863f-496c-a85f-8c95c3c2abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35da48ee-6662-4096-981d-e75e32d056e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35da48ee-6662-4096-981d-e75e32d056e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701690106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a238a9f-fd2c-432c-9bd8-87214309fa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:18Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb578eb-55f9-4c90-ba34-159792bff97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb578eb-55f9-4c90-ba34-159792bff97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2298bfd8-1e90-45df-968f-0eb9121e18f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2298bfd8-1e90-45df-968f-0eb9121e18f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a238a9f-fd2c-432c-9bd8-87214309fa89', 'volume_name': 'volume-7a238a9f-fd2c-432c-9bd8-87214309fa89', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc05b609-44d5-4cb2-995e-6cabe4af5601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc05b609-44d5-4cb2-995e-6cabe4af5601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0612a05-5ca3-4fe7-8caa-40855b9e611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:17 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume 7a238a9f-fd2c-432c-9bd8-87214309fa89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a238a9f-fd2c-432c-9bd8-87214309fa89', 'volume_size': 1} Apr 17 16:24:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:18 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7" returned: 0 in 0.493s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.478s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7c9af0-2c96-45f1-ba52-0eb69e25710c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208bdb17-cce5-4144-b793-7aaf6c3e4932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Creating offline snapshot 7faa3c86-230c-4611-91b2-9e1466a18bdc of volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (a0f469fa-014a-474b-9896-a718b2397f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f857179-bd2c-44c8-a727-81204a430d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2760559-940e-465e-993e-1eb96a3c6376]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Volume volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 (a9d7cb52-91e4-45fa-9180-171f60b9cec7): created successfully Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208bdb17-cce5-4144-b793-7aaf6c3e4932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (fdda3317-7982-4aac-b862-dca782c10e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f857179-bd2c-44c8-a727-81204a430d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730901028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:18Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dfc62c-5f58-45ba-bf88-e1c412b93065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dfc62c-5f58-45ba-bf88-e1c412b93065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5da243b-3474-49a6-8d5c-54b606301f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5da243b-3474-49a6-8d5c-54b606301f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d92baa-3cd0-4fe0-87f3-3ae763b2acbd', 'volume_name': 'volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad61ef8-281c-4662-aefa-67cebe22763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad61ef8-281c-4662-aefa-67cebe22763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5382d51a-cdd6-460c-a368-1d6d6091ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd', 'volume_size': 1} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:18 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-68f1c453-d35a-42d7-891a-aecd321aaa2e tempest-VolumesActionsTest-1729207964 None] Created volume successfully. Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:18 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece Apr 17 16:24:18 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (153e42bb-7a23-4c1e-b039-7763f326a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb91d89-8cb7-4d1f-a570-33e33dbe47d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb91d89-8cb7-4d1f-a570-33e33dbe47d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1804694894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c28a51-b92c-4c3d-93e7-9f7b43f19e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:18Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836bb216-bd57-4b6f-9185-a37cb7d3e76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836bb216-bd57-4b6f-9185-a37cb7d3e76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fa13a1-f40b-4cdb-94d1-98a00e81c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fa13a1-f40b-4cdb-94d1-98a00e81c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c28a51-b92c-4c3d-93e7-9f7b43f19e21', 'volume_name': 'volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bb3617-8479-4acd-b28f-66774a2f3685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bb3617-8479-4acd-b28f-66774a2f3685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4150d0ad-f594-4486-8f63-825c4516143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume 97c28a51-b92c-4c3d-93e7-9f7b43f19e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21', 'volume_size': 1} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (74c5146a-e261-4cb7-9b7b-6d666046ac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe6d7ea-4db2-43f3-ab6f-a11a9f32eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe6d7ea-4db2-43f3-ab6f-a11a9f32eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351555058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4ab89f-e625-4c8b-85ea-75e1112adb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:19Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f807ac-a416-4643-945e-090897239b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f807ac-a416-4643-945e-090897239b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acfd5c7-6846-4e68-b103-aa7a0fcd138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acfd5c7-6846-4e68-b103-aa7a0fcd138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4ab89f-e625-4c8b-85ea-75e1112adb81', 'volume_name': 'volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4721ae61-e84f-49b7-b07c-222605e99885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4721ae61-e84f-49b7-b07c-222605e99885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf0eeed-c2f6-4579-a16d-67cc14e5ff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume cf4ab89f-e625-4c8b-85ea-75e1112adb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81', 'volume_size': 1} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (d8396421-863a-4d79-bd45-cbf000b493c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0307f1-2741-4fe5-af2d-07736f6ef3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0307f1-2741-4fe5-af2d-07736f6ef3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1247458002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae1cb11-770c-4b15-a7d5-1b6b92768077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:19Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5569e39-258e-4d99-98c2-4d24fb76d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5569e39-258e-4d99-98c2-4d24fb76d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c7fb2f-ca36-4d8b-9658-66d820ba9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c7fb2f-ca36-4d8b-9658-66d820ba9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae1cb11-770c-4b15-a7d5-1b6b92768077', 'volume_name': 'volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a176e5-d8dd-4d49-bb4d-70a39928e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a176e5-d8dd-4d49-bb4d-70a39928e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674256b9-ff6c-4750-9b2f-d94f47554047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume 5ae1cb11-770c-4b15-a7d5-1b6b92768077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077', 'volume_size': 1} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-a9d7cb52-91e4-45fa-9180-171f60b9cec7-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:18 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece" returned: 0 in 0.637s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Lock "cinder-a9d7cb52-91e4-45fa-9180-171f60b9cec7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:18 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc 1G Apr 17 16:24:18 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-quobyte-a9d7cb52-91e4-45fa-9180-171f60b9cec7" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-a9d7cb52-91e4-45fa-9180-171f60b9cec7" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fde433-843f-4336-bade-b8c2ebe6788f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:18 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 Apr 17 16:24:18 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:19 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc 1G" returned: 0 in 0.504s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:19 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc Apr 17 16:24:19 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:19 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7" returned: 0 in 0.527s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:19 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7 Apr 17 16:24:19 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:19 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:19 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc is being set with open permissions: ugo+rw Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:19 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc Apr 17 16:24:19 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:19 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a9d7cb52-91e4-45fa-9180-171f60b9cec7" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-a9d7cb52-91e4-45fa-9180-171f60b9cec7" released by "delete_volume" :: held 0.984s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Created reservations ['e4c02c94-9995-443e-9953-524e5204a6b4', '22831a33-723c-4821-844e-3a0041833a01', '457e44e9-b4f5-4378-9bdb-59766357d94d', '6def32a8-5e45-4b30-a08a-f03961d2972a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:19 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:19 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:20 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc" returned: 0 in 0.443s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.384s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3152986d-8fb4-4e2e-925f-79d99c43e6a9,created_at=2026-04-17T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1024441316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3152986d-8fb4-4e2e-925f-79d99c43e6a9,host='devstack@QuobyteHD#QuobyteHD',id=d66700cb-9dc0-4642-9e30-1baef2530105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c219cf425e464eaf5a999d9dffec57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:15Z,use_quota=True,user_id='b561035089be47fbbd6424b172a060ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33cbbcd4-066c-402d-b896-19c4ae7609c3),volume_type_id=33cbbcd4-066c-402d-b896-19c4ae7609c3)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Creating volume d66700cb-9dc0-4642-9e30-1baef2530105 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:20 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:20 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 1073741824 Apr 17 16:24:20 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:20 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f5aa8b77-3a45-476b-93fe-3f8354e09c6a tempest-VolumesSnapshotListTestJSON-1519553874 None] Create snapshot completed successfully Apr 17 16:24:20 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.440s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:20 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Deleted volume successfully. Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1bb65c77-1ab6-45ad-995b-1b14e64483ef tempest-VolumesActionsTest-768168808 None] Lock "cinder-a9d7cb52-91e4-45fa-9180-171f60b9cec7-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:20 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 1073741824" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:20 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 Apr 17 16:24:20 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (2d6d1da9-8512-4a94-8971-95c21c908e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:21 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0420368f-4e3f-42d9-8bb6-ed7c31cb98c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.400s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701690106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a238a9f-fd2c-432c-9bd8-87214309fa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:18Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Creating volume 7a238a9f-fd2c-432c-9bd8-87214309fa89 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:21 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0420368f-4e3f-42d9-8bb6-ed7c31cb98c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2089848014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8ef8a3-1ee7-432d-834d-b5ab8ef14143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:21Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:21 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 1073741824 Apr 17 16:24:21 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf7ab43-c2f9-41c4-ae34-b8dcf78b71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf7ab43-c2f9-41c4-ae34-b8dcf78b71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc99964-b21c-4572-ab89-2c323ce70508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc99964-b21c-4572-ab89-2c323ce70508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c8ef8a3-1ee7-432d-834d-b5ab8ef14143', 'volume_name': 'volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78b040-2736-4639-9296-9dc94425ee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78b040-2736-4639-9296-9dc94425ee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d923ed9e-2325-4e9e-bd55-88bd91a0321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:21 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Volume 2c8ef8a3-1ee7-432d-834d-b5ab8ef14143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143', 'volume_size': 1} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0062c144-27fd-41d8-8a77-ea9294d34f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66700cb-9dc0-4642-9e30-1baef2530105', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3430fb1-670e-4940-95e5-1222477b681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:21 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Volume volume-d66700cb-9dc0-4642-9e30-1baef2530105 (d66700cb-9dc0-4642-9e30-1baef2530105): created successfully Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3430fb1-670e-4940-95e5-1222477b681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Flow 'volume_create_manager' (fbbb6b39-7896-456b-907b-d8ad1ca2f653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:21 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f4bf4bb3-edb1-4dbd-bf83-bc2aef02c321 tempest-GroupsTest-1496050001 None] Created volume successfully. Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-7faa3c86-230c-4611-91b2-9e1466a18bdc-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-7faa3c86-230c-4611-91b2-9e1466a18bdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-quobyte-7faa3c86-230c-4611-91b2-9e1466a18bdc" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-7faa3c86-230c-4611-91b2-9e1466a18bdc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Deleting offline snapshot 7faa3c86-230c-4611-91b2-9e1466a18bdc of volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] snapshot_file for this snap is: volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbdba2d-2162-4f37-a2f1-c2b632bb2240]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:21 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc Apr 17 16:24:21 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:21 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 1073741824" returned: 0 in 0.601s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:22 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 Apr 17 16:24:22 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:22 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc" returned: 0 in 0.502s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[036e7b5d-0fdf-40fc-b765-7e5bd86cf398]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:22 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece Apr 17 16:24:22 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:22 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89" returned: 0 in 0.453s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.162s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730901028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:18Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Creating volume d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:22 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0612a05-5ca3-4fe7-8caa-40855b9e611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a238a9f-fd2c-432c-9bd8-87214309fa89', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:22 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd 1073741824 Apr 17 16:24:22 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc67173-ef84-4f0f-b31f-6a77d897c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:22 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 (7a238a9f-fd2c-432c-9bd8-87214309fa89): created successfully Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc67173-ef84-4f0f-b31f-6a77d897c484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (db5f0ccb-863f-496c-a85f-8c95c3c2abd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:22 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8347c91f-49d5-4396-b21a-6373bd46d528 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created volume successfully. Apr 17 16:24:22 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c8b2fcbd-5245-4bcd-97c3-9276190dbab3 tempest-GroupsTest-1496050001 None] Update group completed successfully. Apr 17 16:24:22 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:22 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc Apr 17 16:24:22 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:23 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd 1073741824" returned: 0 in 0.548s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:23 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd Apr 17 16:24:23 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:23 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc" returned: 0 in 0.534s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:23 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc Apr 17 16:24:23 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:23 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd" returned: 0 in 0.465s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.131s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1804694894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c28a51-b92c-4c3d-93e7-9f7b43f19e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:18Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Creating volume 97c28a51-b92c-4c3d-93e7-9f7b43f19e21 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:23 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5382d51a-cdd6-460c-a368-1d6d6091ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b40679-11f0-4aac-865a-ab8f0589746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:23 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 1073741824 Apr 17 16:24:23 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:23 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd (d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd): created successfully Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b40679-11f0-4aac-865a-ab8f0589746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (a0f469fa-014a-474b-9896-a718b2397f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:23 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2bc1954f-3f01-4b30-bc3f-69573d427710 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created volume successfully. Apr 17 16:24:23 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.7faa3c86-230c-4611-91b2-9e1466a18bdc" returned: 0 in 0.475s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-7faa3c86-230c-4611-91b2-9e1466a18bdc" released by "_delete_snapshot" :: held 2.083s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" released by "delete_snapshot" :: held 2.100s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:23 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-103f346a-121a-4baf-bcac-4a9ef7aae080 tempest-GroupsTest-1496050001 None] Update group completed successfully. Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Created reservations ['243146f7-a333-4056-85ad-f55948f467d8', '611045f8-6704-4d6a-a33b-5ab0a361cc71', '998f1501-432b-48b0-98f1-b48842f45894', '3cc11535-a615-40cd-9a1d-cc476657e939'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:23 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Delete snapshot completed successfully. Apr 17 16:24:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-894a78de-f0a6-4f49-be70-3c3c92262bed tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-7faa3c86-230c-4611-91b2-9e1466a18bdc-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:24 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 1073741824" returned: 0 in 0.564s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:24 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 Apr 17 16:24:24 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:24 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21" returned: 0 in 0.428s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.916s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351555058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4ab89f-e625-4c8b-85ea-75e1112adb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:19Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Creating volume cf4ab89f-e625-4c8b-85ea-75e1112adb81 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:24 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:24 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 1073741824 Apr 17 16:24:24 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4150d0ad-f594-4486-8f63-825c4516143c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697d488b-9f5c-4973-8147-cda7a42ece8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:24 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 (97c28a51-b92c-4c3d-93e7-9f7b43f19e21): created successfully Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697d488b-9f5c-4973-8147-cda7a42ece8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (153e42bb-7a23-4c1e-b039-7763f326a211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:24 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b41ba817-a657-432b-9275-01881f868a9f tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created volume successfully. Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-e7435d81-bd10-4085-bd06-978890747ece-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-e7435d81-bd10-4085-bd06-978890747ece-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-quobyte-e7435d81-bd10-4085-bd06-978890747ece" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-e7435d81-bd10-4085-bd06-978890747ece" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Deleting offline snapshot e7435d81-bd10-4085-bd06-978890747ece of volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] snapshot_file for this snap is: volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b64e2-df7c-4109-9b28-e5107245257b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:24 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece Apr 17 16:24:24 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Acquiring lock "cinder-quobyte-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Lock "cinder-quobyte-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fb2795-2a02-45ba-aa96-d139b8b9718b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:25 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e Apr 17 16:24:25 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:25 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 1073741824" returned: 0 in 0.566s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:25 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 Apr 17 16:24:25 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:25 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece" returned: 0 in 0.549s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e4f123-6f92-42d6-9efe-48145fbf544c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:25 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 Apr 17 16:24:25 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:25 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e" returned: 0 in 0.519s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:25 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e Apr 17 16:24:25 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:25 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81" returned: 0 in 0.450s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.751s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1247458002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae1cb11-770c-4b15-a7d5-1b6b92768077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308ad2633ac249659ae2198d353b113a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:19Z,use_quota=True,user_id='7eb036f2b0f24708b040f5cdc93a80ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Creating volume 5ae1cb11-770c-4b15-a7d5-1b6b92768077 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:25 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf0eeed-c2f6-4579-a16d-67cc14e5ff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:25 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 1073741824 Apr 17 16:24:25 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69df7206-a18e-461f-b9c2-0cec17de4aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:25 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 (cf4ab89f-e625-4c8b-85ea-75e1112adb81): created successfully Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69df7206-a18e-461f-b9c2-0cec17de4aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (74c5146a-e261-4cb7-9b7b-6d666046ac1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b019217b-0b9c-438b-abc6-32c51c66d58e tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created volume successfully. Apr 17 16:24:25 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:25 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece Apr 17 16:24:25 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:25 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e" returned: 0 in 0.427s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Lock "cinder-quobyte-5a7aac4d-07bf-43ee-bad6-cb4a10c7cd2e" released by "delete_volume" :: held 0.976s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Acquiring lock "cinder-quobyte-d66700cb-9dc0-4642-9e30-1baef2530105" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Lock "cinder-quobyte-d66700cb-9dc0-4642-9e30-1baef2530105" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4f7599-ae2d-49af-ae82-8aff68ae45d3]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:26 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 Apr 17 16:24:26 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:26 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 1073741824" returned: 0 in 0.553s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:26 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 Apr 17 16:24:26 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:26 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece" returned: 0 in 0.542s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:26 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece Apr 17 16:24:26 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:26 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105" returned: 0 in 0.511s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:26 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105 Apr 17 16:24:26 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:26 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077" returned: 0 in 0.471s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.244s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2089848014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8ef8a3-1ee7-432d-834d-b5ab8ef14143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:21Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Creating volume 2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:26 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674256b9-ff6c-4750-9b2f-d94f47554047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:26 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 1073741824 Apr 17 16:24:26 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f1f5e-fd72-4d56-8224-912d045e5850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:26 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Volume volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 (5ae1cb11-770c-4b15-a7d5-1b6b92768077): created successfully Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f1f5e-fd72-4d56-8224-912d045e5850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Flow 'volume_create_manager' (d8396421-863a-4d79-bd45-cbf000b493c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:26 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-de5b2306-b1b5-4b7e-a9c5-99ca47c283a5 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created volume successfully. Apr 17 16:24:26 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.e7435d81-bd10-4085-bd06-978890747ece" returned: 0 in 0.419s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-e7435d81-bd10-4085-bd06-978890747ece" released by "_delete_snapshot" :: held 2.044s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" released by "delete_snapshot" :: held 2.067s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Created reservations ['0c894624-cf7d-4fc9-be28-0b70b54cea92', '19dea668-7795-4835-84f9-c690f5c3cd45', 'e480d44c-f50b-48a5-9dfe-3db720f29708', 'b99bfff9-25e9-4656-8089-54e69b421f2a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:26 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Delete snapshot completed successfully. Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d4424c9f-47d2-4f22-9d3a-2e4ebfbf6496 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-e7435d81-bd10-4085-bd06-978890747ece-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:26 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d66700cb-9dc0-4642-9e30-1baef2530105" returned: 0 in 0.449s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Lock "cinder-quobyte-d66700cb-9dc0-4642-9e30-1baef2530105" released by "delete_volume" :: held 0.980s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Created reservations ['418a0f9f-d2b5-4de5-b1b2-63e991450231'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:27 devstack cinder-volume[82061]: WARNING cinder.quota [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1331136482 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1331136482, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:24:27 devstack cinder-volume[82061]: WARNING cinder.quota [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1331136482 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1331136482, it is now deprecated. Please use the default quota class for default quota. Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Created reservations ['1821f25e-dd30-491f-8248-589388e8c4b9', '471bfe5a-62a3-4279-ab33-49ed2a812651', '1d3def2d-65d7-423e-82ab-e121745cada9', '29a999dc-7623-44bc-a978-e5d202d09b6e'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Created reservations ['d4b2435b-cd10-44db-b904-9cbdd0f89942', '500b2ee4-ef0c-4861-b6ef-1b55d172c9a0', '12caa826-105d-450a-b377-1828700663a7', '5e3d5a15-ae3d-4d6d-8a2a-f7f1a46dba04'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:27 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:27 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:27 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 1073741824" returned: 0 in 0.611s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:27 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 Apr 17 16:24:27 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-5ae1cb11-770c-4b15-a7d5-1b6b92768077-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-5ae1cb11-770c-4b15-a7d5-1b6b92768077-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-5ae1cb11-770c-4b15-a7d5-1b6b92768077" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-5ae1cb11-770c-4b15-a7d5-1b6b92768077" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[37531415-f8e2-4196-a714-a545ae803a41]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:27 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 Apr 17 16:24:27 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:27 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:27 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-55f05875-6399-45aa-a63c-80627711d77a tempest-GroupsTest-1496050001 None] Delete group completed successfully. Apr 17 16:24:27 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143" returned: 0 in 0.464s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d923ed9e-2325-4e9e-bd55-88bd91a0321d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b213ae0a-10b8-42d2-964b-7d65082d8734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:27 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Volume volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 (2c8ef8a3-1ee7-432d-834d-b5ab8ef14143): created successfully Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b213ae0a-10b8-42d2-964b-7d65082d8734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (2d6d1da9-8512-4a94-8971-95c21c908e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:27 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-cab7dcda-20a4-4ab2-8f4a-c0b41b983179 tempest-VolumesActionsTest-1729207964 None] Created volume successfully. Apr 17 16:24:27 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:27 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077 Apr 17 16:24:27 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-86f0f1f6-26fa-4bd6-a119-bbcf53c396a9-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-86f0f1f6-26fa-4bd6-a119-bbcf53c396a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-quobyte-86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Deleting offline snapshot 86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 of volume 5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] snapshot_file for this snap is: volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218d948-5901-4582-99b2-df3217535834]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:28 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 Apr 17 16:24:28 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:28 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5ae1cb11-770c-4b15-a7d5-1b6b92768077" returned: 0 in 0.455s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-5ae1cb11-770c-4b15-a7d5-1b6b92768077" released by "delete_volume" :: held 0.996s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created reservations ['e890df03-7f64-4e41-b878-99761b9f8d21', '8b9d0ccf-222b-4602-b18d-8df705c55517', '0c924eeb-cd64-4257-bdfe-641c3fc268fa', '2aa7aa6d-d725-4eec-818a-249ee338d39f'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:28 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:28 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:28 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" returned: 0 in 0.579s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b105182-b3cc-48cf-94bf-61053034e9d5]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:28 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 Apr 17 16:24:28 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Lock "cinder-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-quobyte-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[87194c23-bf55-4743-a639-ba24fabab580]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:28 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 Apr 17 16:24:28 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:29 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:29 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Deleted volume successfully. Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0fb9211e-d9ce-464c-bbb9-6383ac35dfd4 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-5ae1cb11-770c-4b15-a7d5-1b6b92768077-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:29 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" returned: 0 in 0.654s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:29 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 Apr 17 16:24:29 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:29 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143" returned: 0 in 0.608s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:29 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143 Apr 17 16:24:29 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-cf4ab89f-e625-4c8b-85ea-75e1112adb81-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-cf4ab89f-e625-4c8b-85ea-75e1112adb81-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-cf4ab89f-e625-4c8b-85ea-75e1112adb81" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-cf4ab89f-e625-4c8b-85ea-75e1112adb81" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7caf7e1-bbc4-4310-a6d6-c64e8af28eae]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:29 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 Apr 17 16:24:29 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:29 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" returned: 0 in 0.588s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:29 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9 Apr 17 16:24:29 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:30 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143" returned: 0 in 0.535s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143" released by "delete_volume" :: held 1.168s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Created reservations ['8e21873d-bdde-4f15-8449-db0208e92bda', '08d58808-414e-498f-950a-060485238844', 'b02eb552-9777-4d57-9bf2-9f9cdf46a356', '35c761e7-1baf-465b-a507-074f03b84202'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:30 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:30 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:30 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81" returned: 0 in 0.634s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:30 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81 Apr 17 16:24:30 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:30 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643.86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" returned: 0 in 0.509s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-86f0f1f6-26fa-4bd6-a119-bbcf53c396a9" released by "_delete_snapshot" :: held 2.415s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" released by "delete_snapshot" :: held 2.429s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Created reservations ['6d4ee9b5-5f95-40a5-9e2d-742c466eeebe', 'c6089748-2ec4-48cd-80d3-8fa4dd431ea1', 'fa32a45d-d75b-43be-b2c5-2ecc2def1e00', 'e53454db-46d3-4f29-89e8-9c4f2848550a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:30 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Delete snapshot completed successfully. Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c26c0485-ad2c-41ae-a091-55f49857b223 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-86f0f1f6-26fa-4bd6-a119-bbcf53c396a9-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:30 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:30 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Deleted volume successfully. Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ed7cf47-3264-4ba7-b705-d3cffdc5f969 tempest-VolumesActionsTest-768168808 None] Lock "cinder-2c8ef8a3-1ee7-432d-834d-b5ab8ef14143-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:30 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-cf4ab89f-e625-4c8b-85ea-75e1112adb81" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-cf4ab89f-e625-4c8b-85ea-75e1112adb81" released by "delete_volume" :: held 1.134s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created reservations ['10b361e5-d1d0-4cac-a1d0-4b128cfb89c5', '5405e111-e5bb-404b-8036-3c37c8029482', 'fd7c3884-1891-4427-8f06-4aa1ca24b0a9', 'dbc0f279-7a21-4c77-aac1-11f8fa74ad51'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:30 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:30 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-5e8335f3-afd8-4bc9-860b-4d62cb9f1643-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-5e8335f3-afd8-4bc9-860b-4d62cb9f1643-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c819fa-2b28-4c33-8a9d-66951eeed7c4]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:31 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.555s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (270a363d-5f38-4f45-807b-c7341ea631e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84d4725-bbbc-4d26-ac13-e700e3b77d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Deleted volume successfully. Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84d4725-bbbc-4d26-ac13-e700e3b77d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1720311165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743805c8-6c10-468e-aaed-19adbde23003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:31Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ee6eb2-e2b6-46b5-a713-8313f2174205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ee6eb2-e2b6-46b5-a713-8313f2174205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:31 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 Apr 17 16:24:31 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fd66c6-d901-40e9-a000-306bad8c324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fd66c6-d901-40e9-a000-306bad8c324b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743805c8-6c10-468e-aaed-19adbde23003', 'volume_name': 'volume-743805c8-6c10-468e-aaed-19adbde23003', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77554523-5413-4e31-952c-3f3076391276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77554523-5413-4e31-952c-3f3076391276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720d12ab-3640-49be-8e96-661251eee6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:31 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Volume 743805c8-6c10-468e-aaed-19adbde23003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743805c8-6c10-468e-aaed-19adbde23003', 'volume_size': 1} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1720311165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743805c8-6c10-468e-aaed-19adbde23003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:31Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Creating volume 743805c8-6c10-468e-aaed-19adbde23003 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:31 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d5631b5d-b233-49e9-8ca4-d1206ad93a9c tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-cf4ab89f-e625-4c8b-85ea-75e1112adb81-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:31 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 1073741824 Apr 17 16:24:31 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-578f318a-9d3b-4fef-9543-934b9846b344 tempest-GroupsV320Test-665000575 None] Group tempest-GroupsV320Test-Group-1944342856: creating Apr 17 16:24:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-578f318a-9d3b-4fef-9543-934b9846b344 tempest-GroupsV320Test-665000575 None] Group tempest-GroupsV320Test-Group-1944342856: created successfully Apr 17 16:24:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-578f318a-9d3b-4fef-9543-934b9846b344 tempest-GroupsV320Test-665000575 None] Create group completed successfully. Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-97c28a51-b92c-4c3d-93e7-9f7b43f19e21-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-97c28a51-b92c-4c3d-93e7-9f7b43f19e21-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-97c28a51-b92c-4c3d-93e7-9f7b43f19e21" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-97c28a51-b92c-4c3d-93e7-9f7b43f19e21" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ea9a5-a4a1-4600-b1d2-6a512f7ec49b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:31 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 Apr 17 16:24:31 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:31 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:31 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643 Apr 17 16:24:31 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:32 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 1073741824" returned: 0 in 0.572s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:32 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 Apr 17 16:24:32 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:32 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21" returned: 0 in 0.529s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:32 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" returned: 0 in 0.432s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-quobyte-5e8335f3-afd8-4bc9-860b-4d62cb9f1643" released by "delete_volume" :: held 1.073s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:32 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21 Apr 17 16:24:32 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Created reservations ['ac28df59-b71d-49d4-9e63-573eafcb4fb0', '94296b0f-f2ba-4679-b68d-4d1b8810d95d', '0fda40ba-977d-449c-8a1c-1046804cc57b', 'fcc51e33-2fac-4189-907d-d22e38f7ee67'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:32 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:32 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:32 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720d12ab-3640-49be-8e96-661251eee6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743805c8-6c10-468e-aaed-19adbde23003', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ac19a2-6946-4a99-a60a-c25ee3009396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:32 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Volume volume-743805c8-6c10-468e-aaed-19adbde23003 (743805c8-6c10-468e-aaed-19adbde23003): created successfully Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ac19a2-6946-4a99-a60a-c25ee3009396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (270a363d-5f38-4f45-807b-c7341ea631e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:32 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d50d6e18-d04d-4d82-b321-cf3da82c66c7 tempest-VolumesActionsTest-1729207964 None] Created volume successfully. Apr 17 16:24:32 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-97c28a51-b92c-4c3d-93e7-9f7b43f19e21" returned: 0 in 0.468s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-97c28a51-b92c-4c3d-93e7-9f7b43f19e21" released by "delete_volume" :: held 1.019s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created reservations ['7cfeb572-97d0-4335-a757-6d66da07066c', '71ef4a54-fd67-4127-99d0-a3f0f4b8eabe', '19554b2d-43b2-4f37-9031-77b7e823601f', '74d74308-8530-4727-be6b-98e25c2fa6b2'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:32 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.443s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:32 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Deleted volume successfully. Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57293320-9c4a-4d42-9bf4-12e3610eee08 tempest-VolumesSnapshotListTestJSON-1519553874 None] Lock "cinder-5e8335f3-afd8-4bc9-860b-4d62cb9f1643-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:32 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:32 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Created reservations ['f2ed992f-443d-499d-a8bb-dc973727d702'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:33 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:33 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:33 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Deleted volume successfully. Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-3ad3b0ad-e07a-4075-9ae5-5bf32525dda1 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-97c28a51-b92c-4c3d-93e7-9f7b43f19e21-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:33 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-751e1571-49ea-457e-a89c-cad53f6c0cd9 tempest-GroupsV320Test-665000575 None] Delete group completed successfully. Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-743805c8-6c10-468e-aaed-19adbde23003-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Lock "cinder-743805c8-6c10-468e-aaed-19adbde23003-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Acquiring lock "cinder-quobyte-743805c8-6c10-468e-aaed-19adbde23003" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-743805c8-6c10-468e-aaed-19adbde23003" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4252cd-f7d8-4f6c-831a-1978dc01304e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:33 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:33 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:33 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 Apr 17 16:24:33 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa227936-4307-4af6-869a-791224ca03b7]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:34 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd Apr 17 16:24:34 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:34 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.467s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:34 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003" returned: 0 in 0.599s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:34 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003 Apr 17 16:24:34 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:34 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:34 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd Apr 17 16:24:34 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:34 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-743805c8-6c10-468e-aaed-19adbde23003" returned: 0 in 0.484s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Lock "cinder-quobyte-743805c8-6c10-468e-aaed-19adbde23003" released by "delete_volume" :: held 1.111s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Created reservations ['dc0ef322-50d9-4391-80bf-e970b768c286', '9c5a2450-70d0-4602-a64e-4f9f13b725ba', '80865b04-7bf9-410d-9c4a-d123ac1901ca', '244a1c7b-1b00-45ed-b802-408264110ef1'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:34 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:34 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:35 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd" released by "delete_volume" :: held 1.120s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created reservations ['dcddbd1c-bbf3-4b35-bf78-836db8e2ba20', '83726871-7fb3-4ab1-97cb-e183d1913aa7', '1d6336d1-95f5-4528-86c6-3c5118c3191a', '8489a4de-7f23-4bae-bbc0-6addb23d6fce'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:35 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:35 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:35 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.549s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Deleted volume successfully. Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2ed0018b-1b89-418f-94c6-8303573e75a6 tempest-VolumesActionsTest-768168808 None] Lock "cinder-743805c8-6c10-468e-aaed-19adbde23003-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (6c39e6eb-9556-4773-be77-44f9c89a704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c260da0-95a2-4bbc-a279-2bb3787dbfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c260da0-95a2-4bbc-a279-2bb3787dbfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1446863116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f506be7f-56c4-4edc-925c-4c2aef2a4877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcd7915-da98-4b4d-a01c-ef86bcafc748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcd7915-da98-4b4d-a01c-ef86bcafc748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b30432f-7be0-451d-bada-8b36f8631703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b30432f-7be0-451d-bada-8b36f8631703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f506be7f-56c4-4edc-925c-4c2aef2a4877', 'volume_name': 'volume-f506be7f-56c4-4edc-925c-4c2aef2a4877', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d21535-aef0-4fcc-a2b8-0748a7aee7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d21535-aef0-4fcc-a2b8-0748a7aee7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468828be-d191-454d-898f-ebd408fb032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:35 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Volume f506be7f-56c4-4edc-925c-4c2aef2a4877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f506be7f-56c4-4edc-925c-4c2aef2a4877', 'volume_size': 1} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1446863116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f506be7f-56c4-4edc-925c-4c2aef2a4877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Creating volume f506be7f-56c4-4edc-925c-4c2aef2a4877 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:35 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:35 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 1073741824 Apr 17 16:24:35 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:35 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Deleted volume successfully. Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1eac1993-0ec6-45e7-b925-0bbc0b32334d tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-d9d92baa-3cd0-4fe0-87f3-3ae763b2acbd-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (c35fed50-711d-47ab-af0e-9c86d1401fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802f64f9-a835-4931-813d-68bd7764a8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802f64f9-a835-4931-813d-68bd7764a8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1873211049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb64d30-759b-4779-b99b-572a5bc08acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47879827-c026-4162-bea7-08de15005f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47879827-c026-4162-bea7-08de15005f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010d35da-15b1-474d-bcf3-294b9afa0053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010d35da-15b1-474d-bcf3-294b9afa0053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb64d30-759b-4779-b99b-572a5bc08acb', 'volume_name': 'volume-fbb64d30-759b-4779-b99b-572a5bc08acb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38660494-1a46-405a-8840-40cbad9b09d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38660494-1a46-405a-8840-40cbad9b09d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a705276f-8656-48ec-816c-9fc17ce6228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Volume fbb64d30-759b-4779-b99b-572a5bc08acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb64d30-759b-4779-b99b-572a5bc08acb', 'volume_size': 1} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (0a341008-5419-47a1-bc1b-9e39f0e9c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d21128-e32f-4931-8892-38c21d9403da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-7a238a9f-fd2c-432c-9bd8-87214309fa89-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d21128-e32f-4931-8892-38c21d9403da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-388776851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f313e54-310f-4e43-bdbe-70cf4dd76798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e331a8-d483-4f7a-a39c-816325da47e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e331a8-d483-4f7a-a39c-816325da47e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b69630-785e-43c9-adcc-a723e104141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b69630-785e-43c9-adcc-a723e104141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f313e54-310f-4e43-bdbe-70cf4dd76798', 'volume_name': 'volume-5f313e54-310f-4e43-bdbe-70cf4dd76798', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88f2c05-b256-4dab-8ab7-e17ca2cf4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88f2c05-b256-4dab-8ab7-e17ca2cf4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47efaca7-7396-47b1-a9af-a4e32e0504d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Volume 5f313e54-310f-4e43-bdbe-70cf4dd76798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f313e54-310f-4e43-bdbe-70cf4dd76798', 'volume_size': 1} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (615a0c90-a795-43d2-ad28-0edd3c84777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d445d1db-d1b2-481b-9a63-5d8e24fc9ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-7a238a9f-fd2c-432c-9bd8-87214309fa89-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:36 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-7a238a9f-fd2c-432c-9bd8-87214309fa89" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d445d1db-d1b2-481b-9a63-5d8e24fc9ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312627697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2abcf6-bc88-496d-82b4-4ecd97644a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0f653e-c868-4d2d-9b1c-749a5b886edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0f653e-c868-4d2d-9b1c-749a5b886edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc2ae57-9613-4ac7-b59c-0bb40aca2180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc2ae57-9613-4ac7-b59c-0bb40aca2180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2abcf6-bc88-496d-82b4-4ecd97644a65', 'volume_name': 'volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1ff538-fbb9-4317-a48c-09fd39542a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1ff538-fbb9-4317-a48c-09fd39542a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5711054-94ba-4669-86b3-835c813b877c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Volume ea2abcf6-bc88-496d-82b4-4ecd97644a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65', 'volume_size': 1} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 1073741824" returned: 0 in 0.900s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (112e7e57-6f3d-4983-b27e-e6e3a3837ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58840048-b8c8-4986-80c7-ddce032c08ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-7a238a9f-fd2c-432c-9bd8-87214309fa89" acquired by "delete_volume" :: waited 0.101s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1029651-2fb1-4780-84e7-eb710546665c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58840048-b8c8-4986-80c7-ddce032c08ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-867368168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaf02a-15b2-490c-ab0f-28dd261d5c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63893a17-72df-4cea-878b-a6f1ad4f74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63893a17-72df-4cea-878b-a6f1ad4f74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676d590b-26f1-451b-a49d-4c75af6e38d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676d590b-26f1-451b-a49d-4c75af6e38d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbaf02a-15b2-490c-ab0f-28dd261d5c94', 'volume_name': 'volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3180290-917b-4c62-9650-8bb79412291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3180290-917b-4c62-9650-8bb79412291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3f2302-89d9-4ae9-9138-59f30b898e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Volume afbaf02a-15b2-490c-ab0f-28dd261d5c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94', 'volume_size': 1} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:36 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 Apr 17 16:24:36 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (7c81d13f-35a8-4e91-8a6f-71e846b3306a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:36 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 Apr 17 16:24:36 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642c27e2-503a-4dc1-8782-e86da4cf823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642c27e2-503a-4dc1-8782-e86da4cf823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1052726983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44337297-96b7-4683-9e3b-a10bb76ddcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:37Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6a56f-eb7e-4fe1-967c-d2e4b6b54614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6a56f-eb7e-4fe1-967c-d2e4b6b54614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdbbf45-aed3-4acd-badb-f5192ca70be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdbbf45-aed3-4acd-badb-f5192ca70be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44337297-96b7-4683-9e3b-a10bb76ddcc6', 'volume_name': 'volume-44337297-96b7-4683-9e3b-a10bb76ddcc6', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d1fc25-d398-4495-a46b-79043aa20f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d1fc25-d398-4495-a46b-79043aa20f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2459849f-326b-46d6-850a-ea53ab304cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Volume 44337297-96b7-4683-9e3b-a10bb76ddcc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44337297-96b7-4683-9e3b-a10bb76ddcc6', 'volume_size': 1} Apr 17 16:24:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:37 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877" returned: 0 in 0.446s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1873211049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb64d30-759b-4779-b99b-572a5bc08acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Creating volume fbb64d30-759b-4779-b99b-572a5bc08acb {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:37 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:37 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb 1073741824 Apr 17 16:24:37 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468828be-d191-454d-898f-ebd408fb032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f506be7f-56c4-4edc-925c-4c2aef2a4877', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea905522-917e-4c97-964b-4bd3ce06591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:37 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89" returned: 0 in 0.570s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:37 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Volume volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 (f506be7f-56c4-4edc-925c-4c2aef2a4877): created successfully Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea905522-917e-4c97-964b-4bd3ce06591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (6c39e6eb-9556-4773-be77-44f9c89a704a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:37 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89 Apr 17 16:24:37 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-68f59647-31a7-4fe7-bbef-31dc97acef86 tempest-CreateVolumesFromImageTest-1848023647 None] Created volume successfully. Apr 17 16:24:37 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7a238a9f-fd2c-432c-9bd8-87214309fa89" returned: 0 in 0.515s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-7a238a9f-fd2c-432c-9bd8-87214309fa89" released by "delete_volume" :: held 1.114s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:37 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb 1073741824" returned: 0 in 0.590s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created reservations ['effa68e9-322f-4ad1-a563-1a8a4585c367', '2b433ffb-81b7-4318-9e0f-d1b6163272c7', 'a1ea5e27-dc8d-4932-8e53-c1a854c1a840', '2d3989dd-8626-423d-b914-9aec1f0b4c33'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:37 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb Apr 17 16:24:37 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:37 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:37 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Flow 'volume_create_manager' (49f20fcc-26cd-477d-b73f-ed78d9042814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da0659c-ae06-43a9-aa92-75abb713fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da0659c-ae06-43a9-aa92-75abb713fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1233277454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e0d96e-79e2-4341-8cb5-00f123712e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de56ba1b15f46da9b324491ef91cc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:38Z,use_quota=True,user_id='957e04bbf014486babb0421b14bb7e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c70b0f-18f4-45fd-9749-b5a2e02352df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c70b0f-18f4-45fd-9749-b5a2e02352df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab44d48-c9fb-4137-9997-bf86d787c481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab44d48-c9fb-4137-9997-bf86d787c481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e0d96e-79e2-4341-8cb5-00f123712e2b', 'volume_name': 'volume-94e0d96e-79e2-4341-8cb5-00f123712e2b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867342c8-8312-4986-9980-20dc62f3e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867342c8-8312-4986-9980-20dc62f3e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c870d573-47c4-436f-9f4e-d07fe4f95cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Volume 94e0d96e-79e2-4341-8cb5-00f123712e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e0d96e-79e2-4341-8cb5-00f123712e2b', 'volume_size': 1} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:38 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb" returned: 0 in 0.403s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-388776851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f313e54-310f-4e43-bdbe-70cf4dd76798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Creating volume 5f313e54-310f-4e43-bdbe-70cf4dd76798 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:38 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a705276f-8656-48ec-816c-9fc17ce6228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb64d30-759b-4779-b99b-572a5bc08acb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:38 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 1073741824 Apr 17 16:24:38 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f41d23d-d380-4d4c-9520-33968fa5edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Volume volume-fbb64d30-759b-4779-b99b-572a5bc08acb (fbb64d30-759b-4779-b99b-572a5bc08acb): created successfully Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f41d23d-d380-4d4c-9520-33968fa5edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (c35fed50-711d-47ab-af0e-9c86d1401fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:38 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ba5037b4-0279-4b9e-b876-d9b4c8408115 tempest-CreateVolumesFromImageTest-1848023647 None] Created volume successfully. Apr 17 16:24:38 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.454s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:38 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Deleted volume successfully. Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78f1dc9a-4c58-4446-afc6-6fe33f0459a2 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-7a238a9f-fd2c-432c-9bd8-87214309fa89-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-fd2279f6-b6e4-44c1-b224-5694cfb6671a-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-fd2279f6-b6e4-44c1-b224-5694cfb6671a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-a63fb74a-7556-424c-a892-5e1e9ae8b20a" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-a63fb74a-7556-424c-a892-5e1e9ae8b20a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-fd2279f6-b6e4-44c1-b224-5694cfb6671a" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-fd2279f6-b6e4-44c1-b224-5694cfb6671a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Deleting offline snapshot fd2279f6-b6e4-44c1-b224-5694cfb6671a of volume a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] snapshot_file for this snap is: volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeef147-497c-4cc9-b2ad-8925176c1169]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:38 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a Apr 17 16:24:38 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:38 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 1073741824" returned: 0 in 0.503s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:38 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 Apr 17 16:24:38 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:39 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a" returned: 0 in 0.484s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44b879d-21ba-4e47-99ae-6dc57a639b2e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:39 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a Apr 17 16:24:39 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:39 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.607s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312627697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2abcf6-bc88-496d-82b4-4ecd97644a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6dd53cac5542ec92f4937d1e8b67db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='74c6367133834495b3f9bb6966ca439b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Creating volume ea2abcf6-bc88-496d-82b4-4ecd97644a65 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:39 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47efaca7-7396-47b1-a9af-a4e32e0504d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f313e54-310f-4e43-bdbe-70cf4dd76798', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:39 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 1073741824 Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f97924-6480-4284-b26e-5633b9c45b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:39 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:39 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Volume volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 (5f313e54-310f-4e43-bdbe-70cf4dd76798): created successfully Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f97924-6480-4284-b26e-5633b9c45b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (0a341008-5419-47a1-bc1b-9e39f0e9c900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:39 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-55b7e1e7-aa1e-43b6-9772-b4e294bd1f70 tempest-CreateVolumesFromImageTest-1848023647 None] Created volume successfully. Apr 17 16:24:39 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a" returned: 0 in 0.463s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:39 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a Apr 17 16:24:39 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:39 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 1073741824" returned: 0 in 0.509s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:39 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 Apr 17 16:24:39 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:40 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a" returned: 0 in 0.478s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:40 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a Apr 17 16:24:40 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:40 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.468s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-867368168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaf02a-15b2-490c-ab0f-28dd261d5c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:36Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Creating volume afbaf02a-15b2-490c-ab0f-28dd261d5c94 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:40 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5711054-94ba-4669-86b3-835c813b877c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af2d443-e47e-4bf3-9b6c-0c6d274b1e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:40 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 1073741824 Apr 17 16:24:40 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:40 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Volume volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 (ea2abcf6-bc88-496d-82b4-4ecd97644a65): created successfully Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af2d443-e47e-4bf3-9b6c-0c6d274b1e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Flow 'volume_create_manager' (615a0c90-a795-43d2-ad28-0edd3c84777e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:40 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a801e38d-b433-487c-99cb-2d30fa49de99 tempest-VolumesActionsTest-1729207964 None] Created volume successfully. Apr 17 16:24:40 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a.fd2279f6-b6e4-44c1-b224-5694cfb6671a" returned: 0 in 0.460s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-fd2279f6-b6e4-44c1-b224-5694cfb6671a" released by "_delete_snapshot" :: held 1.944s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-a63fb74a-7556-424c-a892-5e1e9ae8b20a" released by "delete_snapshot" :: held 1.961s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created reservations ['7dd49d35-5dcd-47a2-bf6c-d6dbbfe2e96a', '63eb2240-4acd-4ffa-adf4-8ce9e93c6a06', 'b0ce2e78-0f5f-44dd-a334-5017d324449e', '7be55526-14a0-4089-9d6a-c2a0bb50bfb9'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:40 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Delete snapshot completed successfully. Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-dcb17c06-1cc0-4103-89d2-2b8bec478c68 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-fd2279f6-b6e4-44c1-b224-5694cfb6671a-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-a63fb74a-7556-424c-a892-5e1e9ae8b20a-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-a63fb74a-7556-424c-a892-5e1e9ae8b20a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "cinder-quobyte-a63fb74a-7556-424c-a892-5e1e9ae8b20a" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-a63fb74a-7556-424c-a892-5e1e9ae8b20a" acquired by "delete_volume" :: waited 0.019s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:40 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 1073741824" returned: 0 in 0.560s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7caa84-1b77-4b0a-9414-53614923b6c4]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:40 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 Apr 17 16:24:40 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:40 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a Apr 17 16:24:40 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "cinder-ea2abcf6-bc88-496d-82b4-4ecd97644a65-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-ea2abcf6-bc88-496d-82b4-4ecd97644a65-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "cinder-quobyte-ea2abcf6-bc88-496d-82b4-4ecd97644a65" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-quobyte-ea2abcf6-bc88-496d-82b4-4ecd97644a65" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e670cc9c-17a0-4794-bed5-7276414c2dec]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:41 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 Apr 17 16:24:41 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:41 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:41 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a" returned: 0 in 0.525s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94" returned: 0 in 0.508s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.485s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1052726983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44337297-96b7-4683-9e3b-a10bb76ddcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18d6972dfb48858c36e073f094e586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:37Z,use_quota=True,user_id='7dfd9119fe444c69a137e5e8317e3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Creating volume 44337297-96b7-4683-9e3b-a10bb76ddcc6 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:41 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:41 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:41 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3f2302-89d9-4ae9-9138-59f30b898e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5099af6b-f6dc-4585-b5a4-e51656380b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:41 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 1073741824 Apr 17 16:24:41 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:41 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Volume volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 (afbaf02a-15b2-490c-ab0f-28dd261d5c94): created successfully Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5099af6b-f6dc-4585-b5a4-e51656380b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (112e7e57-6f3d-4983-b27e-e6e3a3837ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-836d48dc-09db-48e7-9671-6f7c27df2434 tempest-CreateVolumesFromImageTest-1848023647 None] Created volume successfully. Apr 17 16:24:41 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:41 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65 Apr 17 16:24:41 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:41 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a63fb74a-7556-424c-a892-5e1e9ae8b20a" returned: 0 in 0.416s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-quobyte-a63fb74a-7556-424c-a892-5e1e9ae8b20a" released by "delete_volume" :: held 0.982s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Created reservations ['6b9f4685-f985-4e43-a418-77ea9b383ad2', 'f40cbeff-8694-4603-b204-16078ccf114f', 'f144d207-8786-44bc-a81a-ccb22c31782a', '2f526b98-10f4-44cc-8c62-cab12c531bdc'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:41 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:41 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:41 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 1073741824" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:41 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 Apr 17 16:24:41 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:42 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ea2abcf6-bc88-496d-82b4-4ecd97644a65" returned: 0 in 0.496s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-quobyte-ea2abcf6-bc88-496d-82b4-4ecd97644a65" released by "delete_volume" :: held 1.046s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Created reservations ['f1154748-1eaf-4682-bbaf-69ae0acc9e1c', 'df60a746-dfcb-47a1-acb5-6ebbec8ca49a', 'e88bdae8-aa13-421c-921b-bd7fb94190db', '22e05dc8-f656-4373-bd7e-9da6c7519940'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:42 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:42 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:42 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:42 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Deleted volume successfully. Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e6aabb22-2bb2-45cc-9252-e0a49d98e874 tempest-CreateVolumesFromSnapshotTest-1022697718 None] Lock "cinder-a63fb74a-7556-424c-a892-5e1e9ae8b20a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:42 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6" returned: 0 in 0.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.261s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1233277454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e0d96e-79e2-4341-8cb5-00f123712e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de56ba1b15f46da9b324491ef91cc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:38Z,use_quota=True,user_id='957e04bbf014486babb0421b14bb7e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Creating volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:42 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2459849f-326b-46d6-850a-ea53ab304cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44337297-96b7-4683-9e3b-a10bb76ddcc6', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:42 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b 1073741824 Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fafbef-2f61-4442-88aa-8c8ea251a49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:42 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:42 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Volume volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 (44337297-96b7-4683-9e3b-a10bb76ddcc6): created successfully Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fafbef-2f61-4442-88aa-8c8ea251a49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Flow 'volume_create_manager' (7c81d13f-35a8-4e91-8a6f-71e846b3306a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:42 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7c716b6c-f386-426e-8c8c-c36d1834f7ef tempest-CreateVolumesFromImageTest-1848023647 None] Created volume successfully. Apr 17 16:24:42 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.450s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:42 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Deleted volume successfully. Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c7dff5f0-be3b-4327-9685-7cb78ddf4d68 tempest-VolumesActionsTest-1729207964 None] Lock "cinder-ea2abcf6-bc88-496d-82b4-4ecd97644a65-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:42 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b 1073741824" returned: 0 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:42 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b Apr 17 16:24:42 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-44337297-96b7-4683-9e3b-a10bb76ddcc6-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-44337297-96b7-4683-9e3b-a10bb76ddcc6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-quobyte-44337297-96b7-4683-9e3b-a10bb76ddcc6" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-44337297-96b7-4683-9e3b-a10bb76ddcc6" acquired by "delete_volume" :: waited 0.026s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af3599-4d0d-47df-bbfd-1ea152ab6192]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:43 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 Apr 17 16:24:43 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:43 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b" returned: 0 in 0.580s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c870d573-47c4-436f-9f4e-d07fe4f95cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e0d96e-79e2-4341-8cb5-00f123712e2b', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99f7c8-9f5f-4d79-990d-5c5ff5208abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:43 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Volume volume-94e0d96e-79e2-4341-8cb5-00f123712e2b (94e0d96e-79e2-4341-8cb5-00f123712e2b): created successfully Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99f7c8-9f5f-4d79-990d-5c5ff5208abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Flow 'volume_create_manager' (49f20fcc-26cd-477d-b73f-ed78d9042814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:43 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7df77acd-b47f-44ce-a813-aeb88d5f3b41 tempest-SnapshotsActionsTest-1560649894 None] Created volume successfully. Apr 17 16:24:43 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6" returned: 0 in 0.633s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:43 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6 Apr 17 16:24:43 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:44 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-44337297-96b7-4683-9e3b-a10bb76ddcc6" returned: 0 in 0.609s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Creating offline snapshot 9905d0be-0f7e-45f0-a9a2-aea922f33aff of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9ce24-ab67-4cea-bee0-2f6d99c2437e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-44337297-96b7-4683-9e3b-a10bb76ddcc6" released by "delete_volume" :: held 1.299s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Created reservations ['9aa5928d-f638-4127-b1aa-dc7c02fafa14', 'f3c91452-c021-41b4-9ee5-7589f66e6b2e', '367c6cd3-e725-4344-804e-836039d0b9b5', '1005366f-d9bd-4412-bf58-2fc2c5ea1069'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:44 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:44 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b Apr 17 16:24:44 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:44 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (3ab9228e-9b2f-4749-8a95-156a10e5c362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26aac5c5-12ed-4f81-b5e3-7456935f5a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26aac5c5-12ed-4f81-b5e3-7456935f5a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-110234411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7768ce62-76ea-4ba6-bee2-f9d8bc607e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:45Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7413d210-324d-49cf-bdbd-a085465d02c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7413d210-324d-49cf-bdbd-a085465d02c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df529ea-dc3f-4f56-8ab3-d11d128bc229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df529ea-dc3f-4f56-8ab3-d11d128bc229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7768ce62-76ea-4ba6-bee2-f9d8bc607e17', 'volume_name': 'volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f7ec1-fa29-466e-b0a0-871aa7305d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f7ec1-fa29-466e-b0a0-871aa7305d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a5282-4ad7-427d-b467-65c9ddf0efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:44 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume 7768ce62-76ea-4ba6-bee2-f9d8bc607e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17', 'volume_size': 1} Apr 17 16:24:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:45 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.471s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:45 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Deleted volume successfully. Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1f206347-a3d3-47e0-99ec-86440dd3cbf7 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-44337297-96b7-4683-9e3b-a10bb76ddcc6-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:45 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b" returned: 0 in 0.618s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:45 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff 1G Apr 17 16:24:45 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-afbaf02a-15b2-490c-ab0f-28dd261d5c94-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-afbaf02a-15b2-490c-ab0f-28dd261d5c94-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-quobyte-afbaf02a-15b2-490c-ab0f-28dd261d5c94" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-afbaf02a-15b2-490c-ab0f-28dd261d5c94" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be01c2d-eb63-4611-90e2-b6abc5690135]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:45 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 Apr 17 16:24:45 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:45 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff 1G" returned: 0 in 0.614s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:45 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:24:45 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:46 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94" returned: 0 in 0.575s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:46 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94 Apr 17 16:24:46 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:46 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:46 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff is being set with open permissions: ugo+rw Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:46 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:24:46 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:46 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afbaf02a-15b2-490c-ab0f-28dd261d5c94" returned: 0 in 0.448s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-afbaf02a-15b2-490c-ab0f-28dd261d5c94" released by "delete_volume" :: held 1.069s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Created reservations ['e9a8f869-4e7e-42c8-a871-54fd6085ac9d', 'a600420d-c5b5-49e8-84bc-8de38775e23c', '32502906-acaa-49e2-9dd5-4c32e9517d45', 'f62e7704-2e22-48a5-919f-a55916d78b03'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:46 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:46 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:46 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.461s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:46 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.info Apr 17 16:24:46 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:47 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:47 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Deleted volume successfully. Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa325e18-09cf-46be-824e-a8d64ed73711 tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-afbaf02a-15b2-490c-ab0f-28dd261d5c94-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:47 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.info" returned: 0 in 0.474s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:47 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.info is being set with open permissions: ugo+rw Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:47 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.info Apr 17 16:24:47 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-5f313e54-310f-4e43-bdbe-70cf4dd76798-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-5f313e54-310f-4e43-bdbe-70cf4dd76798-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:47 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-quobyte-5f313e54-310f-4e43-bdbe-70cf4dd76798" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.info" returned: 0 in 0.447s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.163s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-5f313e54-310f-4e43-bdbe-70cf4dd76798" acquired by "delete_volume" :: waited 0.036s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-110234411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7768ce62-76ea-4ba6-bee2-f9d8bc607e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:45Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Creating volume 7768ce62-76ea-4ba6-bee2-f9d8bc607e17 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:47 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:47 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 1073741824 Apr 17 16:24:47 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd125e-03e8-4915-b3cc-7282b307a84d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:47 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b7701ee3-cd2f-43fa-af97-e188036f8164 tempest-SnapshotsActionsTest-1560649894 None] Create snapshot completed successfully Apr 17 16:24:47 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 Apr 17 16:24:47 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:48 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 1073741824" returned: 0 in 0.559s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:48 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798" returned: 0 in 0.569s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:48 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 Apr 17 16:24:48 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:48 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798 Apr 17 16:24:48 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:48 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17" returned: 0 in 0.454s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a5282-4ad7-427d-b467-65c9ddf0efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da541338-7cae-40cc-9e86-5c754095e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:48 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 (7768ce62-76ea-4ba6-bee2-f9d8bc607e17): created successfully Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da541338-7cae-40cc-9e86-5c754095e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (3ab9228e-9b2f-4749-8a95-156a10e5c362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:48 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8e5c3b46-0df6-4575-9895-30ec5bf2e398 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created volume successfully. Apr 17 16:24:48 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-5f313e54-310f-4e43-bdbe-70cf4dd76798" returned: 0 in 0.560s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-5f313e54-310f-4e43-bdbe-70cf4dd76798" released by "delete_volume" :: held 1.187s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Created reservations ['e95e59b0-22f0-4b2a-9cce-f5b830ca13fc', '611c585e-26df-4ad8-8ad0-4eb17533bdeb', 'f2aab859-adad-49dd-be87-b155723943c5', 'eab4846c-0de4-4bf3-a0b0-c0a25f2bcfbf'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:49 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:49 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Creating offline snapshot 64338865-b7f8-4270-9dd7-3d1c97e1ebea of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcf80f5-ef8f-43d8-b608-fbd83ff1c9b6]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:49 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:24:49 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (792ef794-7b99-40fe-8322-a65dc474eb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a1bf5d-92b9-4497-9d4a-0bc2f73390a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a1bf5d-92b9-4497-9d4a-0bc2f73390a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835259581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c3411b-a6ec-4965-96f5-8c29482744b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:49Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18618bf1-1246-430e-bc52-7fcbea8ead3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18618bf1-1246-430e-bc52-7fcbea8ead3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efa5897-aabd-4961-8b4f-cd145fedf207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efa5897-aabd-4961-8b4f-cd145fedf207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c3411b-a6ec-4965-96f5-8c29482744b5', 'volume_name': 'volume-60c3411b-a6ec-4965-96f5-8c29482744b5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df847fe-e1f8-4f0b-af3d-904751dac99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df847fe-e1f8-4f0b-af3d-904751dac99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833acac6-ad42-4d0a-94c2-373f681c8854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume 60c3411b-a6ec-4965-96f5-8c29482744b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c3411b-a6ec-4965-96f5-8c29482744b5', 'volume_size': 1} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (76ae6cef-ba60-4f6d-9bd2-b40f11c89145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:49 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ad4a05-9e8f-49dd-ba41-bdd4b23e5a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.564s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:49 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Deleted volume successfully. Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ad4a05-9e8f-49dd-ba41-bdd4b23e5a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968173512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e36c58c-7841-4233-8041-e7fcd7e0cd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:49Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d83b3-ba54-4c05-acae-9a5ad43d250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d83b3-ba54-4c05-acae-9a5ad43d250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ec0d0a-04d0-4d46-873a-df98cdf68faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ec0d0a-04d0-4d46-873a-df98cdf68faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e36c58c-7841-4233-8041-e7fcd7e0cd62', 'volume_name': 'volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac714a7-9365-45b9-9037-475f74e1b67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac714a7-9365-45b9-9037-475f74e1b67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726cae4e-645f-4c52-9e66-928d214a11cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume 7e36c58c-7841-4233-8041-e7fcd7e0cd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62', 'volume_size': 1} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f06e08aa-0fbe-4e84-b425-e87fc4784a9a tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-5f313e54-310f-4e43-bdbe-70cf4dd76798-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (3924cdbf-888b-43c3-9119-039e83d33f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b412c8-dae2-4fe7-b135-6c5e3d10a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b412c8-dae2-4fe7-b135-6c5e3d10a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522438922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a75e829-ff72-477a-8a0a-20412a21cf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:50Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b0df44-3784-46b9-9fcd-cc45cf3db93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b0df44-3784-46b9-9fcd-cc45cf3db93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51328516-cd1b-4c82-9f87-b67a00963b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51328516-cd1b-4c82-9f87-b67a00963b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a75e829-ff72-477a-8a0a-20412a21cf9e', 'volume_name': 'volume-3a75e829-ff72-477a-8a0a-20412a21cf9e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb47a3b5-86a4-4056-b880-bac858a0a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb47a3b5-86a4-4056-b880-bac858a0a28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1053230-0df3-43f3-8d1b-de0ba9fbaaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:49 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume 3a75e829-ff72-477a-8a0a-20412a21cf9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a75e829-ff72-477a-8a0a-20412a21cf9e', 'volume_size': 1} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-fbb64d30-759b-4779-b99b-572a5bc08acb-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-fbb64d30-759b-4779-b99b-572a5bc08acb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-quobyte-fbb64d30-759b-4779-b99b-572a5bc08acb" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-fbb64d30-759b-4779-b99b-572a5bc08acb" acquired by "delete_volume" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d64c8a-ecdc-46d4-b8d5-9af9eb8e3dc9]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:49 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.768s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:50 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea 1G Apr 17 16:24:50 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (f80b1194-88d1-4a09-9b40-5c4f064acfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3079b4c6-da62-436d-8823-3ae6123ddf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb Apr 17 16:24:50 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3079b4c6-da62-436d-8823-3ae6123ddf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418203259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcebbea-9320-4fb0-9c1e-85b2b8841bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:50Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec65a10-7743-42e8-be30-de64d5ca3684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec65a10-7743-42e8-be30-de64d5ca3684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4a008d-b41d-477c-932f-92cfd30b9105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4a008d-b41d-477c-932f-92cfd30b9105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdcebbea-9320-4fb0-9c1e-85b2b8841bd0', 'volume_name': 'volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24de96bb-00ea-4559-8920-c5ad187ebc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24de96bb-00ea-4559-8920-c5ad187ebc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3adc8f7-da6d-492f-9a7f-2a3aa29613bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume bdcebbea-9320-4fb0-9c1e-85b2b8841bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0', 'volume_size': 1} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (6ad92f66-cc64-48be-9713-83b1e4c8053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfa8287-d168-4fa2-85f6-2e22c764f00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfa8287-d168-4fa2-85f6-2e22c764f00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-360662161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af8e4f8-2891-41c4-b006-32c2bc77f9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:50Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9766bdb-8cae-4555-88fb-29404990e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9766bdb-8cae-4555-88fb-29404990e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c653fd-9eb9-4296-8127-5b131ead9eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c653fd-9eb9-4296-8127-5b131ead9eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af8e4f8-2891-41c4-b006-32c2bc77f9a6', 'volume_name': 'volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a137d12e-238d-43cb-8e5e-cce035316be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a137d12e-238d-43cb-8e5e-cce035316be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10d98a8-86a6-44b4-b500-e59027b6eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:50 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume 3af8e4f8-2891-41c4-b006-32c2bc77f9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6', 'volume_size': 1} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:50 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea 1G" returned: 0 in 0.669s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:50 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb" returned: 0 in 0.698s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:50 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea Apr 17 16:24:50 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:50 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb Apr 17 16:24:50 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:51 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea" returned: 0 in 0.476s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:51 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea is being set with open permissions: ugo+rw Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:51 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:51 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea Apr 17 16:24:51 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fbb64d30-759b-4779-b99b-572a5bc08acb" returned: 0 in 0.492s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-fbb64d30-759b-4779-b99b-572a5bc08acb" released by "delete_volume" :: held 1.227s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Created reservations ['7dad3d3f-135f-493e-a98c-0e17b1e82d3f', 'ecebc3fc-c97b-4886-bdc8-fa69fbe1efe0', 'c39a381d-853c-4df7-9053-11fb282fb22a', 'f964509b-703b-4df6-89b2-4d067d780a85'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:51 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:51 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:51 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea" returned: 0 in 0.450s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.211s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835259581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c3411b-a6ec-4965-96f5-8c29482744b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:49Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Creating volume 60c3411b-a6ec-4965-96f5-8c29482744b5 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:51 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:51 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 1073741824 Apr 17 16:24:51 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-018b5bdf-7f4b-4acd-8514-82e1acda563d tempest-SnapshotsActionsTest-1560649894 None] Create snapshot completed successfully Apr 17 16:24:51 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:51 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:51 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Deleted volume successfully. Apr 17 16:24:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b891f455-c81b-454c-be95-b2cca5ee93ab tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-fbb64d30-759b-4779-b99b-572a5bc08acb-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-f506be7f-56c4-4edc-925c-4c2aef2a4877-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-f506be7f-56c4-4edc-925c-4c2aef2a4877-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "cinder-quobyte-f506be7f-56c4-4edc-925c-4c2aef2a4877" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-f506be7f-56c4-4edc-925c-4c2aef2a4877" acquired by "delete_volume" :: waited 0.020s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3b0c4-76d3-447b-8fc6-fbfc3e1ff038]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:52 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 Apr 17 16:24:52 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:52 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 1073741824" returned: 0 in 0.635s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:52 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 Apr 17 16:24:52 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-64338865-b7f8-4270-9dd7-3d1c97e1ebea-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-64338865-b7f8-4270-9dd7-3d1c97e1ebea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-64338865-b7f8-4270-9dd7-3d1c97e1ebea" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-64338865-b7f8-4270-9dd7-3d1c97e1ebea" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Deleting offline snapshot 64338865-b7f8-4270-9dd7-3d1c97e1ebea of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] snapshot_file for this snap is: volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b652aab-ded2-41b9-b9f9-4ede81d23b22]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:52 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea Apr 17 16:24:52 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:52 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5" returned: 0 in 0.470s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:52 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.161s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968173512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e36c58c-7841-4233-8041-e7fcd7e0cd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:49Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Creating volume 7e36c58c-7841-4233-8041-e7fcd7e0cd62 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:52 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877" returned: 0 in 0.649s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:52 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 1073741824 Apr 17 16:24:52 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833acac6-ad42-4d0a-94c2-373f681c8854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c3411b-a6ec-4965-96f5-8c29482744b5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042efa83-3dd1-462d-95ea-ea7fe8279000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:52 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume volume-60c3411b-a6ec-4965-96f5-8c29482744b5 (60c3411b-a6ec-4965-96f5-8c29482744b5): created successfully Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042efa83-3dd1-462d-95ea-ea7fe8279000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (792ef794-7b99-40fe-8322-a65dc474eb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:52 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877 Apr 17 16:24:52 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:52 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-57bc8bdd-4404-4c68-9070-1f2f9756c991 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created volume successfully. Apr 17 16:24:53 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea" returned: 0 in 0.551s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b92f551-b74c-4987-99c6-77ee04f2ce00]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:53 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:24:53 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:53 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 1073741824" returned: 0 in 0.568s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:53 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f506be7f-56c4-4edc-925c-4c2aef2a4877" returned: 0 in 0.574s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-quobyte-f506be7f-56c4-4edc-925c-4c2aef2a4877" released by "delete_volume" :: held 1.267s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:53 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 Apr 17 16:24:53 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Created reservations ['6517c0db-e0ff-4921-97a6-5786f48e9c7c', 'a4315e48-daa5-4296-b7d5-db5ec4643199', 'd8334ddb-05a6-4f0d-a555-1bee348bcf48', 'f8fdc80e-52b2-4520-9e75-83bde6e36d8d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:53 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:53 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:53 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.660s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:53 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea Apr 17 16:24:53 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:54 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62" returned: 0 in 0.589s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522438922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a75e829-ff72-477a-8a0a-20412a21cf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:50Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Creating volume 3a75e829-ff72-477a-8a0a-20412a21cf9e {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:54 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:54 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726cae4e-645f-4c52-9e66-928d214a11cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e13d700-116b-46c7-abf3-66b32d140364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:54 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e 1073741824 Apr 17 16:24:54 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:54 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Deleted volume successfully. Apr 17 16:24:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 (7e36c58c-7841-4233-8041-e7fcd7e0cd62): created successfully Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e13d700-116b-46c7-abf3-66b32d140364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (76ae6cef-ba60-4f6d-9bd2-b40f11c89145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:54 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4b3c45f2-0bb1-43ec-83ce-f889a74bde09 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created volume successfully. Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8abb1270-4cdd-41e9-a381-decdab6f51cc tempest-CreateVolumesFromImageTest-1848023647 None] Lock "cinder-f506be7f-56c4-4edc-925c-4c2aef2a4877-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:54 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea" returned: 0 in 0.560s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:54 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea Apr 17 16:24:54 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Flow 'volume_create_manager' (e1d913fe-5931-42ae-b890-1c87213fbeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137a4db8-5f76-455c-9f54-f11aa7af3f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137a4db8-5f76-455c-9f54-f11aa7af3f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1610362612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b9c259-de95-4586-bda8-671471e66391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3185c15ca7334431be64fef5aee84fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:55Z,use_quota=True,user_id='5860a9ac71aa4b9895b76dc79f3f344e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7ffb7c-8fcf-4e77-9f52-01c6c37c2672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7ffb7c-8fcf-4e77-9f52-01c6c37c2672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f84190-1dd3-4dec-96a9-03b9859ee6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f84190-1dd3-4dec-96a9-03b9859ee6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b9c259-de95-4586-bda8-671471e66391', 'volume_name': 'volume-a5b9c259-de95-4586-bda8-671471e66391', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447bed23-8492-4024-9d2c-f5663b0aad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447bed23-8492-4024-9d2c-f5663b0aad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb6178-54e5-486b-b13e-32003432329d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Volume a5b9c259-de95-4586-bda8-671471e66391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b9c259-de95-4586-bda8-671471e66391', 'volume_size': 1} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:54 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e 1073741824" returned: 0 in 0.782s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:54 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e Apr 17 16:24:54 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:54 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.64338865-b7f8-4270-9dd7-3d1c97e1ebea" returned: 0 in 0.627s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-64338865-b7f8-4270-9dd7-3d1c97e1ebea" released by "_delete_snapshot" :: held 2.460s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" released by "delete_snapshot" :: held 2.471s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Created reservations ['445584f8-bda3-44df-8515-d3ebba58843b', 'ac0a3354-d9bb-4172-940a-5bd8d668c1e4', 'a08a2146-3347-40f4-b455-108f219e70d5', '272e6438-761a-45b3-b118-6c6ab99630fe'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Delete snapshot completed successfully. Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-65173348-6215-4672-bbde-b154a48c17e7 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-64338865-b7f8-4270-9dd7-3d1c97e1ebea-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:55 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e" returned: 0 in 0.459s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.122s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418203259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcebbea-9320-4fb0-9c1e-85b2b8841bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:50Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Creating volume bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:55 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1053230-0df3-43f3-8d1b-de0ba9fbaaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a75e829-ff72-477a-8a0a-20412a21cf9e', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b83b1c-8194-4b32-9a93-80fd8b239c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:55 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 1073741824 Apr 17 16:24:55 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:55 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume volume-3a75e829-ff72-477a-8a0a-20412a21cf9e (3a75e829-ff72-477a-8a0a-20412a21cf9e): created successfully Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b83b1c-8194-4b32-9a93-80fd8b239c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (3924cdbf-888b-43c3-9119-039e83d33f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1896015a-e505-4ea5-be65-8bf661d475cf tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created volume successfully. Apr 17 16:24:55 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 1073741824" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:55 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 Apr 17 16:24:55 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Flow 'volume_create_manager' (6379080d-1518-490c-ab6f-4188e71bca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dae09b-a093-4bf4-90a1-f1a9bd1a0fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dae09b-a093-4bf4-90a1-f1a9bd1a0fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb39117-84ae-47f1-9eab-5e64af4211e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35883c802cda478a96bd6bcb1b9aabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:56Z,use_quota=True,user_id='22506832f9974bb8ba03bdc1b6916b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac7c31c-2466-4259-96e7-3d1ce4ac1e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac7c31c-2466-4259-96e7-3d1ce4ac1e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15291cf5-ceef-444e-a25a-4676174f71ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15291cf5-ceef-444e-a25a-4676174f71ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb39117-84ae-47f1-9eab-5e64af4211e3', 'volume_name': 'volume-1cb39117-84ae-47f1-9eab-5e64af4211e3', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6056ab9-15ec-4d86-a8c6-46f17243c618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6056ab9-15ec-4d86-a8c6-46f17243c618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c4f363-56c6-4785-bdba-bc8b7150d0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:56 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Volume 1cb39117-84ae-47f1-9eab-5e64af4211e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb39117-84ae-47f1-9eab-5e64af4211e3', 'volume_size': 1} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:56 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.092s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-360662161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af8e4f8-2891-41c4-b006-32c2bc77f9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618092272d774a97b2b6aee51607fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:50Z,use_quota=True,user_id='2746fd8b53234b0aace6409ed6175b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Creating volume 3af8e4f8-2891-41c4-b006-32c2bc77f9a6 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:56 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3adc8f7-da6d-492f-9a7f-2a3aa29613bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7464ec37-f509-4e11-8006-220d52ed253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:56 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 1073741824 Apr 17 16:24:56 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:56 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 (bdcebbea-9320-4fb0-9c1e-85b2b8841bd0): created successfully Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7464ec37-f509-4e11-8006-220d52ed253f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (f80b1194-88d1-4a09-9b40-5c4f064acfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-70d8e6bf-f0e7-4c65-a464-2680a1a415ce tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created volume successfully. Apr 17 16:24:56 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 1073741824" returned: 0 in 0.540s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:57 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 Apr 17 16:24:57 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:57 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6" returned: 0 in 0.431s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1610362612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b9c259-de95-4586-bda8-671471e66391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3185c15ca7334431be64fef5aee84fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:55Z,use_quota=True,user_id='5860a9ac71aa4b9895b76dc79f3f344e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Creating volume a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:24:57 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10d98a8-86a6-44b4-b500-e59027b6eed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74adef1f-e4cc-48be-abd3-db562ffa2e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:57 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 1073741824 Apr 17 16:24:57 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:57 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Volume volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 (3af8e4f8-2891-41c4-b006-32c2bc77f9a6): created successfully Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74adef1f-e4cc-48be-abd3-db562ffa2e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Flow 'volume_create_manager' (6ad92f66-cc64-48be-9713-83b1e4c8053f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:57 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6e15bc09-3951-4439-bb50-236bf7402499 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created volume successfully. Apr 17 16:24:57 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 1073741824" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:57 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 Apr 17 16:24:57 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-3af8e4f8-2891-41c4-b006-32c2bc77f9a6-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-3af8e4f8-2891-41c4-b006-32c2bc77f9a6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-quobyte-3af8e4f8-2891-41c4-b006-32c2bc77f9a6" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-3af8e4f8-2891-41c4-b006-32c2bc77f9a6" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa8997-ec02-463b-a181-a9d26cb0bd30]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:58 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 Apr 17 16:24:58 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:58 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391" returned: 0 in 0.429s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.336s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Creating offline snapshot 88b8c381-c6d2-40d1-a081-8d68e10c9cc0 of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb6178-54e5-486b-b13e-32003432329d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b9c259-de95-4586-bda8-671471e66391', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d032c33b-3c6e-41a9-9b61-ebd8598f2542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c2f48-a023-40ae-a4f3-5ab7798c31e9]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:58 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Volume volume-a5b9c259-de95-4586-bda8-671471e66391 (a5b9c259-de95-4586-bda8-671471e66391): created successfully Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d032c33b-3c6e-41a9-9b61-ebd8598f2542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Flow 'volume_create_manager' (e1d913fe-5931-42ae-b890-1c87213fbeda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:24:58 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-68c28db2-b083-41ea-8e0c-ce29e4553f28 tempest-VolumesDeleteCascade-1805170858 None] Created volume successfully. Apr 17 16:24:58 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:24:58 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:58 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:58 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6 Apr 17 16:24:58 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:58 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.493s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:24:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:58 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 1G Apr 17 16:24:58 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:59 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3af8e4f8-2891-41c4-b006-32c2bc77f9a6" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-3af8e4f8-2891-41c4-b006-32c2bc77f9a6" released by "delete_volume" :: held 1.025s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created reservations ['2d62167b-cb0e-4837-9a64-3f14c4e5c9a8', '74446617-7464-4bfb-8922-27345f7f1050', '2368072a-3ca1-4b3e-97ef-2471c467d633', 'ffba7540-9fac-4f16-a403-7e1479bc3902'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:59 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:24:59 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:59 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 1G" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:59 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 Apr 17 16:24:59 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:24:59 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.453s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:24:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Deleted volume successfully. Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b28962e9-3ac9-43b0-abaf-b4667f71f6fc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-3af8e4f8-2891-41c4-b006-32c2bc77f9a6-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:24:59 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0" returned: 0 in 0.430s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:24:59 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 is being set with open permissions: ugo+rw Apr 17 16:24:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:24:59 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 Apr 17 16:24:59 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:00 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-quobyte-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.036s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb39117-84ae-47f1-9eab-5e64af4211e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35883c802cda478a96bd6bcb1b9aabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:24:56Z,use_quota=True,user_id='22506832f9974bb8ba03bdc1b6916b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Creating volume 1cb39117-84ae-47f1-9eab-5e64af4211e3 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:00 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:00 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 1073741824 Apr 17 16:25:00 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0" acquired by "delete_volume" :: waited 0.055s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3025f835-341d-42b3-8ff2-d20790eed890]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:00 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-329ec5d0-66fd-4906-8ecf-36ed05a2e452 tempest-SnapshotsActionsTest-1560649894 None] Create snapshot completed successfully Apr 17 16:25:00 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 Apr 17 16:25:00 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:00 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 1073741824" returned: 0 in 0.501s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:00 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0" returned: 0 in 0.484s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:00 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 Apr 17 16:25:00 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:00 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0 Apr 17 16:25:00 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-88b8c381-c6d2-40d1-a081-8d68e10c9cc0-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-88b8c381-c6d2-40d1-a081-8d68e10c9cc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-88b8c381-c6d2-40d1-a081-8d68e10c9cc0" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-88b8c381-c6d2-40d1-a081-8d68e10c9cc0" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Deleting offline snapshot 88b8c381-c6d2-40d1-a081-8d68e10c9cc0 of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] snapshot_file for this snap is: volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:01 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3" returned: 0 in 0.457s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.204s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c4f363-56c6-4785-bdba-bc8b7150d0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb39117-84ae-47f1-9eab-5e64af4211e3', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:01 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5c1385-3be6-4db4-a7ef-79c22602c953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22cb4ac-107d-4e00-8f74-16403bd930f2]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0" returned: 0 in 0.488s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:01 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Volume volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 (1cb39117-84ae-47f1-9eab-5e64af4211e3): created successfully Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5c1385-3be6-4db4-a7ef-79c22602c953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Flow 'volume_create_manager' (6379080d-1518-490c-ab6f-4188e71bca02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Creating offline snapshot 901bca3c-53f6-4930-8a3a-160284d37f92 of volume a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:25:01 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-712eda68-a9e4-468f-b904-e03d9466f353 tempest-CinderUnicodeTest-1421695809 None] Created volume successfully. Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0" released by "delete_volume" :: held 1.034s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[552110b1-929d-460a-b9fd-53aaef2c6af8]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:01 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 Apr 17 16:25:01 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created reservations ['e652735e-3c91-4e58-9c80-66a596b9d241', 'df4efb75-1fe1-4a8f-908d-0385df4e626f', '9f00bf2e-19d7-4832-b796-fcc1929f2c5c', '66883a37-bfad-4785-a579-b9726ec0fb38'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:01 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 Apr 17 16:25:01 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:01 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:01 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Flow 'volume_create_manager' (faf3a791-84db-4a8a-899f-d9f358723202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab49f7d-4706-482e-aa08-a101e030d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab49f7d-4706-482e-aa08-a101e030d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-895924431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a3c817-a097-4f11-8dd5-ecf5523f31fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35883c802cda478a96bd6bcb1b9aabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:02Z,use_quota=True,user_id='22506832f9974bb8ba03bdc1b6916b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67af848f-2ed3-4b35-b4ff-fb9a3f09ef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67af848f-2ed3-4b35-b4ff-fb9a3f09ef83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d245fd5-6315-40a8-a890-c666c7beed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d245fd5-6315-40a8-a890-c666c7beed15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a3c817-a097-4f11-8dd5-ecf5523f31fb', 'volume_name': 'volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3df60a-e887-4c71-9964-77e478d0a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3df60a-e887-4c71-9964-77e478d0a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf7a66e-84a5-4460-a036-290f435dcb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:01 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Volume 24a3c817-a097-4f11-8dd5-ecf5523f31fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb', 'volume_size': 1} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:01 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.473s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:01 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Deleted volume successfully. Apr 17 16:25:01 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0" returned: 0 in 0.633s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1750370a-423d-459d-b39b-b2e995d0ba9b tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-bdcebbea-9320-4fb0-9c1e-85b2b8841bd0-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[90abc6b9-6c51-4c2a-82cf-63b571b30042]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:01 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391" returned: 0 in 0.586s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:02 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 1G Apr 17 16:25:02 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:02 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:02 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-3a75e829-ff72-477a-8a0a-20412a21cf9e-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-3a75e829-ff72-477a-8a0a-20412a21cf9e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=261,cinder:UPDATE=344,cinder:INSERT=79,cinder:DELETE=21 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:UPDATE=306,cinder:SELECT=236,cinder:INSERT=69,cinder:DELETE=35 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:25:02 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-quobyte-3a75e829-ff72-477a-8a0a-20412a21cf9e" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 1G" returned: 0 in 0.507s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-3a75e829-ff72-477a-8a0a-20412a21cf9e" acquired by "delete_volume" :: waited 0.026s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:02 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 Apr 17 16:25:02 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:02 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c4f239-9026-4a2b-9938-7ae3f54eb6ee]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.562s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:02 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 Apr 17 16:25:02 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:02 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e Apr 17 16:25:02 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:02 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:03 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 is being set with open permissions: ugo+rw Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:03 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 Apr 17 16:25:03 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:03 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:03 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e" returned: 0 in 0.507s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:03 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0 Apr 17 16:25:03 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:03 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e Apr 17 16:25:03 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:03 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:03 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.88b8c381-c6d2-40d1-a081-8d68e10c9cc0" returned: 0 in 0.429s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:03 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.info Apr 17 16:25:03 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-88b8c381-c6d2-40d1-a081-8d68e10c9cc0" released by "_delete_snapshot" :: held 2.191s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:03 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-3a75e829-ff72-477a-8a0a-20412a21cf9e" returned: 0 in 0.439s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" released by "delete_snapshot" :: held 2.206s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-3a75e829-ff72-477a-8a0a-20412a21cf9e" released by "delete_volume" :: held 0.989s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created reservations ['1e518b69-148e-423d-9134-c2dd7016117c', '977a9a6b-453b-4602-bc66-229bfe627641', '545d6b4c-8999-4990-885c-8cefcb8d8850', '6c6bb0af-f1ee-4d5b-bbba-e6e2477cbb60'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Created reservations ['fbb4f54e-5b13-4741-ae13-8d31ab8eab99', '96817494-fae3-418c-aac6-7a81eb605d4b', 'aed88af9-931a-40a8-9a34-a0836b84b6de', 'f6090dbd-232c-4de9-b75e-a5528e3eafc2'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Delete snapshot completed successfully. Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7a5ef3c3-09d1-4731-89aa-20da106c54d6 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-88b8c381-c6d2-40d1-a081-8d68e10c9cc0-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:03 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:03 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:03 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.info" returned: 0 in 0.434s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:03 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.info is being set with open permissions: ugo+rw Apr 17 16:25:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:03 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.info Apr 17 16:25:03 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:04 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.420s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Deleted volume successfully. Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a452fdf5-bb31-49c8-a485-408568f85300 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-3a75e829-ff72-477a-8a0a-20412a21cf9e-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:04 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.info" returned: 0 in 0.416s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-895924431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a3c817-a097-4f11-8dd5-ecf5523f31fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35883c802cda478a96bd6bcb1b9aabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:02Z,use_quota=True,user_id='22506832f9974bb8ba03bdc1b6916b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Creating volume 24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:04 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:04 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb 1073741824 Apr 17 16:25:04 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ddd4a68c-2c83-4231-8605-26e904a1a51c tempest-VolumesDeleteCascade-1805170858 None] Create snapshot completed successfully Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-7e36c58c-7841-4233-8041-e7fcd7e0cd62-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-7e36c58c-7841-4233-8041-e7fcd7e0cd62-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-quobyte-7e36c58c-7841-4233-8041-e7fcd7e0cd62" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-7e36c58c-7841-4233-8041-e7fcd7e0cd62" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6a3de-66b9-4b42-b083-37a9f217cd73]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:04 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 Apr 17 16:25:04 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:04 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb 1073741824" returned: 0 in 0.571s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:04 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb Apr 17 16:25:04 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:05 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62" returned: 0 in 0.496s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:05 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62 Apr 17 16:25:05 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:05 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb" returned: 0 in 0.444s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.757s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Creating offline snapshot c574b7ef-992c-4de5-acc0-b306e877043f of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf7a66e-84a5-4460-a036-290f435dcb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00161cf2-eebc-4ef1-89ff-6502eb8e52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fe4cb2-f5f6-48f6-920d-098eadcc7474]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:05 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Volume volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb (24a3c817-a097-4f11-8dd5-ecf5523f31fb): created successfully Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00161cf2-eebc-4ef1-89ff-6502eb8e52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Flow 'volume_create_manager' (faf3a791-84db-4a8a-899f-d9f358723202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:05 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1bfddecf-9022-464d-90c8-9e6edb99a1bc tempest-CinderUnicodeTest-1421695809 None] Created volume successfully. Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:05 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:05 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:05 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7e36c58c-7841-4233-8041-e7fcd7e0cd62" returned: 0 in 0.547s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-7e36c58c-7841-4233-8041-e7fcd7e0cd62" released by "delete_volume" :: held 1.075s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created reservations ['49fb2fc4-848d-4520-a3ee-8b87d5ed2d04', '21586118-29ac-4b1f-af9b-a34562e75490', 'b57453ee-05ae-41ec-9f2c-66d081458008', 'a95a2e6f-7c8f-4884-86cf-62bcc3c9fb33'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:05 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:05 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:06 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.539s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:06 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f 1G Apr 17 16:25:06 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:06 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Deleted volume successfully. Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de3b180f-a53a-4749-9faa-22112f03dd25 tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-7e36c58c-7841-4233-8041-e7fcd7e0cd62-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:06 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f 1G" returned: 0 in 0.527s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:06 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f Apr 17 16:25:06 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-60c3411b-a6ec-4965-96f5-8c29482744b5-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-60c3411b-a6ec-4965-96f5-8c29482744b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-quobyte-60c3411b-a6ec-4965-96f5-8c29482744b5" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-60c3411b-a6ec-4965-96f5-8c29482744b5" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7785b8-ab45-4758-9eac-220059f1b65f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:06 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 Apr 17 16:25:06 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:06 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f" returned: 0 in 0.462s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:06 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f is being set with open permissions: ugo+rw Apr 17 16:25:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:07 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f Apr 17 16:25:07 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:07 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5" returned: 0 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:07 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5 Apr 17 16:25:07 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:07 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f" returned: 0 in 0.444s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.960s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Creating offline snapshot f74ba8fe-4413-4b9c-82ea-30e123f03597 of volume a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:25:07 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-def6af03-7f96-4995-8ffa-2dcfc682e903 tempest-SnapshotsActionsTest-1560649894 None] Create snapshot completed successfully Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c543cf-7eb1-453a-adf6-397603a8e361]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:07 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 Apr 17 16:25:07 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:07 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-60c3411b-a6ec-4965-96f5-8c29482744b5" returned: 0 in 0.423s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-60c3411b-a6ec-4965-96f5-8c29482744b5" released by "delete_volume" :: held 0.936s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-c574b7ef-992c-4de5-acc0-b306e877043f-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-c574b7ef-992c-4de5-acc0-b306e877043f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-c574b7ef-992c-4de5-acc0-b306e877043f" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-c574b7ef-992c-4de5-acc0-b306e877043f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Deleting offline snapshot c574b7ef-992c-4de5-acc0-b306e877043f of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] snapshot_file for this snap is: volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created reservations ['91003c07-251b-488c-bbac-38a41ed439fa', '3ef185d4-57ea-45b8-b7e0-e03d9d84f35f', '3caf0f0e-d07f-47f0-a9b1-424825434613', '13f9483f-3df3-4cec-afaf-e336d8f79c66'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af73a4e-3047-4ca7-b262-b3ad0296fe33]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:07 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:07 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:07 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f Apr 17 16:25:07 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:07 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92" returned: 0 in 0.485s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b9c259-de95-4586-bda8-671471e66391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:08 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 1G Apr 17 16:25:08 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:08 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.425s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:08 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Deleted volume successfully. Apr 17 16:25:08 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-26b644ec-057a-44a4-b2a8-cd8076c982fb tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-60c3411b-a6ec-4965-96f5-8c29482744b5-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebdeb56-01c5-44d5-b57e-5d77b779dda7]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:08 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:08 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:08 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 1G" returned: 0 in 0.525s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:08 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 Apr 17 16:25:08 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:08 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.471s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:08 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f Apr 17 16:25:08 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:08 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597" returned: 0 in 0.448s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:08 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 is being set with open permissions: ugo+rw Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-7768ce62-76ea-4ba6-bee2-f9d8bc607e17-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:08 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 Apr 17 16:25:08 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-7768ce62-76ea-4ba6-bee2-f9d8bc607e17-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "cinder-quobyte-7768ce62-76ea-4ba6-bee2-f9d8bc607e17" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-7768ce62-76ea-4ba6-bee2-f9d8bc607e17" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[48633050-a16c-4045-a615-2a0de92e5719]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:09 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 Apr 17 16:25:09 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:09 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f" returned: 0 in 0.474s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:09 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f Apr 17 16:25:09 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:09 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597" returned: 0 in 0.458s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.244s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e254d5fb-5460-4fe8-b8fb-19ae02c7d2db tempest-VolumesDeleteCascade-1805170858 None] Create snapshot completed successfully Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Creating offline snapshot f3e13f01-d423-4245-bd91-cc972aecfeb8 of volume 24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc537b1-fd3c-49ab-9ab0-7a8e85530e2e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:09 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:09 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17 Apr 17 16:25:09 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:09 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb Apr 17 16:25:09 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-a5b9c259-de95-4586-bda8-671471e66391-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-a5b9c259-de95-4586-bda8-671471e66391-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Performing cascade delete. {{(pid=82061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-901bca3c-53f6-4930-8a3a-160284d37f92-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-901bca3c-53f6-4930-8a3a-160284d37f92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-901bca3c-53f6-4930-8a3a-160284d37f92" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-901bca3c-53f6-4930-8a3a-160284d37f92" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Deleting offline snapshot 901bca3c-53f6-4930-8a3a-160284d37f92 of volume a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] snapshot_file for this snap is: volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa4e405-ec1b-4b74-92dd-6d1577338aed]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:09 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 Apr 17 16:25:09 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:09 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.c574b7ef-992c-4de5-acc0-b306e877043f" returned: 0 in 0.520s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-c574b7ef-992c-4de5-acc0-b306e877043f" released by "_delete_snapshot" :: held 2.027s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" released by "delete_snapshot" :: held 2.045s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Created reservations ['d1761c2e-ca3d-4c1b-b32b-41161a654902', 'fcc874f0-7722-405e-b265-5a295e0176bc', '4ec06841-79bf-4f6a-893d-d152fdd6f82d', '3101442d-3ccb-4c43-8fdd-6cfbdfabccea'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Delete snapshot completed successfully. Apr 17 16:25:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f97d4beb-2c0c-44a2-87c4-06951182d592 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-c574b7ef-992c-4de5-acc0-b306e877043f-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:10 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-7768ce62-76ea-4ba6-bee2-f9d8bc607e17" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-quobyte-7768ce62-76ea-4ba6-bee2-f9d8bc607e17" released by "delete_volume" :: held 0.998s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:10 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb" returned: 0 in 0.577s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Created reservations ['b43f4bb9-285e-42ff-9d42-4eb7f63be90b', '13d94678-3c05-4876-bcaf-238a331ea2e9', 'fe8974bb-fb87-43f7-9554-ab0e2abe887d', '09003683-e5a1-49f9-8068-6807c400d893'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:10 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 1G Apr 17 16:25:10 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:10 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:10 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:10 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92" returned: 0 in 0.562s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b9c259-de95-4586-bda8-671471e66391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc183e37-a116-468a-bf8f-23438ed2717a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:10 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 Apr 17 16:25:10 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:10 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:10 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 1G" returned: 0 in 0.500s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.439s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:10 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Deleted volume successfully. Apr 17 16:25:10 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 Apr 17 16:25:10 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-10126abd-8487-4001-80de-7ba17891a5dc tempest-CreateVolumesFromSourceVolumeTest-1211049896 None] Lock "cinder-7768ce62-76ea-4ba6-bee2-f9d8bc607e17-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:10 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391" returned: 0 in 0.503s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[74da970d-887a-44e7-af9c-e895e58e9368]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:10 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 Apr 17 16:25:10 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:11 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:11 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 is being set with open permissions: ugo+rw Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:11 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 Apr 17 16:25:11 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:11 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597" returned: 0 in 0.557s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b9c259-de95-4586-bda8-671471e66391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ff3c06-a2f1-43e2-8762-2177cea4a979]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:11 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 Apr 17 16:25:11 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:11 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8" returned: 0 in 0.558s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:11 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.info Apr 17 16:25:11 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:12 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92" returned: 0 in 0.576s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b9c259-de95-4586-bda8-671471e66391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc960b7-bd03-46bb-9672-c4a216c56e95]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:12 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 Apr 17 16:25:12 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:12 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.info" returned: 0 in 0.471s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:12 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.info is being set with open permissions: ugo+rw Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:12 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.info Apr 17 16:25:12 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:12 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.info" returned: 0 in 0.417s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.059s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.356s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:12 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Creating offline snapshot 173ea9e3-093b-4520-9542-8afb6b433c5d of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:25:12 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7b18cc38-bd18-455b-966e-8d44b5c46a31 tempest-CinderUnicodeTest-1421695809 None] Create snapshot completed successfully Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391" returned: 0 in 0.554s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0119a30-c85f-4b04-aed7-bdc4b007c8e3]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:12 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 Apr 17 16:25:12 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:12 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:12 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:13 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:13 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92 Apr 17 16:25:13 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:13 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:13 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d 1G Apr 17 16:25:13 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "cinder-f3e13f01-d423-4245-bd91-cc972aecfeb8-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-f3e13f01-d423-4245-bd91-cc972aecfeb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "cinder-quobyte-24a3c817-a097-4f11-8dd5-ecf5523f31fb" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-24a3c817-a097-4f11-8dd5-ecf5523f31fb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "cinder-quobyte-f3e13f01-d423-4245-bd91-cc972aecfeb8" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-f3e13f01-d423-4245-bd91-cc972aecfeb8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Deleting offline snapshot f3e13f01-d423-4245-bd91-cc972aecfeb8 of volume 24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] snapshot_file for this snap is: volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[95498346-6d2c-40be-87de-84853bf1d982]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:13 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.901bca3c-53f6-4930-8a3a-160284d37f92" returned: 0 in 0.531s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 -F qcow2 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:13 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 -F qcow2 Apr 17 16:25:13 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:13 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 Apr 17 16:25:13 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:13 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d 1G" returned: 0 in 0.549s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:13 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d Apr 17 16:25:13 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:14 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b9c259-de95-4586-bda8-671471e66391 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 -F qcow2" returned: 0 in 0.455s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:14 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-901bca3c-53f6-4930-8a3a-160284d37f92" released by "_delete_snapshot" :: held 4.288s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb0bb89-5500-41b6-b521-6d9421b79a72]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" released by "delete_snapshot" :: held 4.320s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:14 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d" returned: 0 in 0.463s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:14 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d is being set with open permissions: ugo+rw Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:14 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d Apr 17 16:25:14 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:14 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb Apr 17 16:25:14 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Created reservations ['f3c25e15-3676-436c-b2ad-b967d77e15b2', '792ad50b-08b7-4b14-9e42-db3f78114934', '2287bd39-db56-4c31-ad03-69bb5247c04d', 'da84880b-0393-4dfc-a1a6-6872e00ff858'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Delete snapshot completed successfully. Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-901bca3c-53f6-4930-8a3a-160284d37f92-delete_snapshot" released by "delete_snapshot" :: held 4.442s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-f74ba8fe-4413-4b9c-82ea-30e123f03597-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-f74ba8fe-4413-4b9c-82ea-30e123f03597-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-f74ba8fe-4413-4b9c-82ea-30e123f03597" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-f74ba8fe-4413-4b9c-82ea-30e123f03597" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Deleting offline snapshot f74ba8fe-4413-4b9c-82ea-30e123f03597 of volume a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] snapshot_file for this snap is: volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[feacfcfa-7946-4983-8d39-6044843b7946]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:14 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 Apr 17 16:25:14 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:14 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb" returned: 0 in 0.504s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:14 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:14 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 Apr 17 16:25:14 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5d0b0cc7-d44a-421a-86ad-23f5e9bdccda tempest-SnapshotsActionsTest-1560649894 None] Create snapshot completed successfully Apr 17 16:25:14 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597" returned: 0 in 0.495s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b9c259-de95-4586-bda8-671471e66391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b176bb32-b7cc-495d-8145-45ca350f3435]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:14 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 Apr 17 16:25:14 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:15 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8" returned: 0 in 0.501s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:15 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8 Apr 17 16:25:15 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:15 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391" returned: 0 in 0.502s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:15 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 Apr 17 16:25:15 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-173ea9e3-093b-4520-9542-8afb6b433c5d-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-173ea9e3-093b-4520-9542-8afb6b433c5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Acquiring lock "cinder-quobyte-173ea9e3-093b-4520-9542-8afb6b433c5d" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-173ea9e3-093b-4520-9542-8afb6b433c5d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Deleting offline snapshot 173ea9e3-093b-4520-9542-8afb6b433c5d of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] snapshot_file for this snap is: volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a34e19c-1c39-4843-9fef-854577b8b595]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:15 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb.f3e13f01-d423-4245-bd91-cc972aecfeb8" returned: 0 in 0.465s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:15 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d Apr 17 16:25:15 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-f3e13f01-d423-4245-bd91-cc972aecfeb8" released by "_delete_snapshot" :: held 2.056s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-24a3c817-a097-4f11-8dd5-ecf5523f31fb" released by "delete_snapshot" :: held 2.068s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Created reservations ['43680807-5df6-497c-b6c2-9389e5524af0', '2ad9347f-13ba-4a93-bc3e-6fbb73a7428a', '116d5e3c-48de-4755-a0c1-8ac66273f53a', '83a92572-456e-4f19-b659-2d21f3f957d3'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:15 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Delete snapshot completed successfully. Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-64a81350-1c68-4b77-bb6f-52a905eb6fc5 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-f3e13f01-d423-4245-bd91-cc972aecfeb8-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:15 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597" returned: 0 in 0.576s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:15 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597 Apr 17 16:25:15 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:16 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d" returned: 0 in 0.556s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1aee6f-1d26-4420-9453-ef0fb7ae914c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:16 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:16 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:16 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391.f74ba8fe-4413-4b9c-82ea-30e123f03597" returned: 0 in 0.448s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-f74ba8fe-4413-4b9c-82ea-30e123f03597" released by "_delete_snapshot" :: held 2.072s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" released by "delete_snapshot" :: held 2.085s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Created reservations ['c296029f-2b3f-4bbe-9d4e-ae1d2ae27202', 'bd56d7ac-7db8-4734-88c7-4c4c80bdd2d8', '59b88959-ad1e-4ed4-b857-6a106c48ae80', '37de50b3-b7e8-45b0-b7cb-5460f7fe5255'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Delete snapshot completed successfully. Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-f74ba8fe-4413-4b9c-82ea-30e123f03597-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Snapshots deleted, issuing volume delete {{(pid=82061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80984e-cdf4-4b28-a8ca-9d947f3754e4]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:16 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 Apr 17 16:25:16 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:16 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:16 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d Apr 17 16:25:16 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "cinder-24a3c817-a097-4f11-8dd5-ecf5523f31fb-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-24a3c817-a097-4f11-8dd5-ecf5523f31fb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "cinder-quobyte-24a3c817-a097-4f11-8dd5-ecf5523f31fb" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-24a3c817-a097-4f11-8dd5-ecf5523f31fb" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b71471-5750-44f7-ae1d-6bafade09f2e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:16 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb Apr 17 16:25:16 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:16 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391" returned: 0 in 0.493s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:16 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391 Apr 17 16:25:16 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:17 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d" returned: 0 in 0.544s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:17 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d Apr 17 16:25:17 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:17 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb" returned: 0 in 0.525s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:17 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb Apr 17 16:25:17 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:17 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a5b9c259-de95-4586-bda8-671471e66391" returned: 0 in 0.465s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-a5b9c259-de95-4586-bda8-671471e66391" released by "delete_volume" :: held 0.989s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Created reservations ['ef4b7504-ed74-4e19-a382-cb2b16b711b6', 'aa37c902-c429-45eb-9f63-f6821c00e846', '2a1d5cec-7f59-43e8-a751-efde9f0cbe54', '73f437f6-a69a-4cff-9805-daa770b5c04a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:17 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:17 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:17 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.173ea9e3-093b-4520-9542-8afb6b433c5d" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-173ea9e3-093b-4520-9542-8afb6b433c5d" released by "_delete_snapshot" :: held 2.117s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" released by "delete_snapshot" :: held 2.129s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Created reservations ['c8610516-b8e0-4f41-8af6-9e68455929e2', 'dcd25c06-0147-485a-a613-5ff4576da9db', '87d80b01-7fe0-4aba-9a2c-dafdec8beeb5', '5f312d7c-3a76-4b96-a2e9-6622c10643a3'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Delete snapshot completed successfully. Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5c0a25be-e528-4f49-9c63-4919bbd0e522 tempest-SnapshotsActionsTest-1446304637 None] Lock "cinder-173ea9e3-093b-4520-9542-8afb6b433c5d-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:17 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-24a3c817-a097-4f11-8dd5-ecf5523f31fb" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-24a3c817-a097-4f11-8dd5-ecf5523f31fb" released by "delete_volume" :: held 1.015s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Created reservations ['dbeccb10-104c-456e-a52f-6e671fc8b558', '4e6853e5-a964-43c1-a417-278736f379b7', '0cdc801f-56ba-4f4e-b0f3-2cb2ff94d950', '473f175e-f81e-4362-87fb-b753934f4393'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:17 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:17 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:17 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.464s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Deleted volume successfully. Apr 17 16:25:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-4a8d3ef3-5f5a-4b55-a1f1-809cfe4ae103 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-a5b9c259-de95-4586-bda8-671471e66391-delete_volume" released by "delete_volume" :: held 8.271s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:18 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.443s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:18 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Deleted volume successfully. Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-c3a7bd98-224f-4b6b-9a75-0ab523d72ffd tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-24a3c817-a097-4f11-8dd5-ecf5523f31fb-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Flow 'volume_create_manager' (4d3a2174-fdba-4b12-9d7d-c93db734efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddd2b70-ab4c-4d65-a6b7-8eca47036e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddd2b70-ab4c-4d65-a6b7-8eca47036e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-580943458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca76f30c-0cc4-4a83-9363-f32481422fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3185c15ca7334431be64fef5aee84fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:18Z,use_quota=True,user_id='5860a9ac71aa4b9895b76dc79f3f344e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b079a279-2368-42c8-b6a9-cc3dd975ffd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b079a279-2368-42c8-b6a9-cc3dd975ffd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20bba78-c9be-4026-9569-4df396d058f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20bba78-c9be-4026-9569-4df396d058f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca76f30c-0cc4-4a83-9363-f32481422fd5', 'volume_name': 'volume-ca76f30c-0cc4-4a83-9363-f32481422fd5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551aae4-02dd-435e-ba7f-ab7175b77562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551aae4-02dd-435e-ba7f-ab7175b77562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1e0bb9-dab5-4949-9717-43754a862e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Volume ca76f30c-0cc4-4a83-9363-f32481422fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca76f30c-0cc4-4a83-9363-f32481422fd5', 'volume_size': 1} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-580943458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca76f30c-0cc4-4a83-9363-f32481422fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3185c15ca7334431be64fef5aee84fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:18Z,use_quota=True,user_id='5860a9ac71aa4b9895b76dc79f3f344e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Creating volume ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:18 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:18 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 1073741824 Apr 17 16:25:18 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "cinder-1cb39117-84ae-47f1-9eab-5e64af4211e3-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-1cb39117-84ae-47f1-9eab-5e64af4211e3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "cinder-9905d0be-0f7e-45f0-a9a2-aea922f33aff-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "cinder-quobyte-1cb39117-84ae-47f1-9eab-5e64af4211e3" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-9905d0be-0f7e-45f0-a9a2-aea922f33aff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-1cb39117-84ae-47f1-9eab-5e64af4211e3" acquired by "delete_volume" :: waited 0.019s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "cinder-quobyte-9905d0be-0f7e-45f0-a9a2-aea922f33aff" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[06618c59-56bf-4ee7-8d7d-e74977e1e91e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-quobyte-9905d0be-0f7e-45f0-a9a2-aea922f33aff" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Deleting offline snapshot 9905d0be-0f7e-45f0-a9a2-aea922f33aff of volume 94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] snapshot_file for this snap is: volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5750921-77c2-44d6-b795-f0b1d3803570]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:18 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 Apr 17 16:25:18 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:18 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:18 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:19 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 1073741824" returned: 0 in 0.552s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:19 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 Apr 17 16:25:19 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:19 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3" returned: 0 in 0.511s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:19 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:19 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3 Apr 17 16:25:19 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.502s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e0d96e-79e2-4341-8cb5-00f123712e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80c116c-90ba-41d2-9a63-31a72e719f41]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:19 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b Apr 17 16:25:19 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:19 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5" returned: 0 in 0.444s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1e0bb9-dab5-4949-9717-43754a862e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca76f30c-0cc4-4a83-9363-f32481422fd5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706ccb7a-501f-4177-a90d-71bbb94d357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:19 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Volume volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 (ca76f30c-0cc4-4a83-9363-f32481422fd5): created successfully Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706ccb7a-501f-4177-a90d-71bbb94d357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Flow 'volume_create_manager' (4d3a2174-fdba-4b12-9d7d-c93db734efb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:19 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-27bfbf63-76bb-465e-9668-7c563e38ef61 tempest-VolumesDeleteCascade-1805170858 None] Created volume successfully. Apr 17 16:25:19 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1cb39117-84ae-47f1-9eab-5e64af4211e3" returned: 0 in 0.418s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-quobyte-1cb39117-84ae-47f1-9eab-5e64af4211e3" released by "delete_volume" :: held 0.952s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Created reservations ['69ee0818-9b52-4648-8dd6-3e784ace6ad1', 'bab80c49-e35f-4d3e-9836-5792247490d8', '9df35874-31ba-4d71-a37b-e3ac5cf0a53c', '78aab068-e848-4c96-ac74-2b176725e116'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:19 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:19 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:19 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b" returned: 0 in 0.513s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:19 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:19 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:20 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:20 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Deleted volume successfully. Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d8318879-0c8e-4cf9-a0ce-be9f10e40e02 tempest-CinderUnicodeTest-1421695809 None] Lock "cinder-1cb39117-84ae-47f1-9eab-5e64af4211e3-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:20 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.561s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:20 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff Apr 17 16:25:20 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Creating offline snapshot 1285822e-a8c6-449c-8d80-3c414af3f350 of volume ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0087cc7c-452b-48a5-b969-7becc9dec0c4]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:20 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 Apr 17 16:25:20 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:21 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b.9905d0be-0f7e-45f0-a9a2-aea922f33aff" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-quobyte-9905d0be-0f7e-45f0-a9a2-aea922f33aff" released by "_delete_snapshot" :: held 2.148s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" released by "delete_snapshot" :: held 2.172s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Created reservations ['5bf9a38d-f673-4dee-957c-d17f52595995', 'cbeb4e99-8aad-4e15-990e-bb446137ca21', '992ff25e-6b51-4f97-ae6c-37f19a912e37', 'd9001aa5-8892-4ae3-8edc-b27a713d3516'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:21 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Delete snapshot completed successfully. Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-645c64bc-6ab4-4573-867c-45d36e2490ba tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-9905d0be-0f7e-45f0-a9a2-aea922f33aff-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:21 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5" returned: 0 in 0.513s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:21 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 1G Apr 17 16:25:21 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:21 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 1G" returned: 0 in 0.480s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:21 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 Apr 17 16:25:21 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "cinder-94e0d96e-79e2-4341-8cb5-00f123712e2b-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-94e0d96e-79e2-4341-8cb5-00f123712e2b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1971b025-bb4e-4246-af5c-481b07df683d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:22 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350" returned: 0 in 0.449s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:22 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 is being set with open permissions: ugo+rw Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:22 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 Apr 17 16:25:22 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:22 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b Apr 17 16:25:22 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:22 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b" returned: 0 in 0.463s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:22 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350" returned: 0 in 0.440s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:22 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b Apr 17 16:25:22 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:22 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.info Apr 17 16:25:22 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:23 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94e0d96e-79e2-4341-8cb5-00f123712e2b" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:23 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-quobyte-94e0d96e-79e2-4341-8cb5-00f123712e2b" released by "delete_volume" :: held 0.932s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.info" returned: 0 in 0.413s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:23 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.info is being set with open permissions: ugo+rw Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:23 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.info Apr 17 16:25:23 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Created reservations ['540ee711-16f0-4aff-8741-5b70bded82ee', '1add64a7-1450-487b-a40d-f35e730a90c2', 'd150d3ec-c6e2-4d1f-9e7e-8b572157d875', '398ea7f8-8ee5-45fa-83ba-8633d07b7878'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:23 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:23 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:23 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.info" returned: 0 in 0.465s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:23 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3d35251d-24fe-4458-bd4c-7d5db8964ce4 tempest-VolumesDeleteCascade-1805170858 None] Create snapshot completed successfully Apr 17 16:25:23 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:23 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Deleted volume successfully. Apr 17 16:25:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fdedadc0-2a7b-47f4-a035-804f591245e5 tempest-SnapshotsActionsTest-1560649894 None] Lock "cinder-94e0d96e-79e2-4341-8cb5-00f123712e2b-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Flow 'volume_create_manager' (60729838-2490-45ec-8f2e-f7e1aab489d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554f096d-af7e-4698-b199-477e47717050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554f096d-af7e-4698-b199-477e47717050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-595955166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00642521-df85-4f38-a1c9-e939851ec840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3185c15ca7334431be64fef5aee84fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1285822e-a8c6-449c-8d80-3c414af3f350,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:24Z,use_quota=True,user_id='5860a9ac71aa4b9895b76dc79f3f344e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc67c206-a4a0-4e13-9db9-d4e82ed39848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc67c206-a4a0-4e13-9db9-d4e82ed39848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb3ce49-ca23-4c19-857c-adaddc314850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb3ce49-ca23-4c19-857c-adaddc314850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00642521-df85-4f38-a1c9-e939851ec840', 'volume_name': 'volume-00642521-df85-4f38-a1c9-e939851ec840', 'volume_size': 1, 'snapshot_id': '1285822e-a8c6-449c-8d80-3c414af3f350'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dee986-ae3b-4f40-a9d2-81dd82191faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dee986-ae3b-4f40-a9d2-81dd82191faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b756d89-b170-4a88-84a6-60335758d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:24 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Volume 00642521-df85-4f38-a1c9-e939851ec840: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00642521-df85-4f38-a1c9-e939851ec840', 'volume_size': 1, 'snapshot_id': '1285822e-a8c6-449c-8d80-3c414af3f350'} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-1285822e-a8c6-449c-8d80-3c414af3f350-00642521-df85-4f38-a1c9-e939851ec840" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-1285822e-a8c6-449c-8d80-3c414af3f350-00642521-df85-4f38-a1c9-e939851ec840" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Creating volume 00642521-df85-4f38-a1c9-e939851ec840 from snapshot 1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-00642521-df85-4f38-a1c9-e939851ec840" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-00642521-df85-4f38-a1c9-e939851ec840" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] snapshot: 1285822e-a8c6-449c-8d80-3c414af3f350, volume: 00642521-df85-4f38-a1c9-e939851ec840, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4db3d2-aa76-4f9b-aefa-859f54b17344]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:24 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 Apr 17 16:25:24 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:24 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca76f30c-0cc4-4a83-9363-f32481422fd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948540b-5a82-49bf-9751-0e14bba89dd3]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:24 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 Apr 17 16:25:24 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:25 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:25 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:25:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:25 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 Apr 17 16:25:25 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:27 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840" returned: 0 in 2.205s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[14555f4c-a01a-4abc-a837-8994f2902990]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:27 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 Apr 17 16:25:27 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Flow 'volume_create_manager' (e6692283-9dce-4728-9c0d-fbc8e3665e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3de3053-e94c-4f4a-b1fc-5d47b2043ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3de3053-e94c-4f4a-b1fc-5d47b2043ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-174121451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8b76cd-20ce-421f-bdeb-28a188899e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8eec02270284f93af533ba2f83a681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:28Z,use_quota=True,user_id='6cc6ebb4bc914216af8c847f7927bd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5e7f15-fadd-4196-b389-d1f72abac0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5e7f15-fadd-4196-b389-d1f72abac0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379a92a7-96a1-48bf-ab00-0578ef7e354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379a92a7-96a1-48bf-ab00-0578ef7e354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c8b76cd-20ce-421f-bdeb-28a188899e5d', 'volume_name': 'volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b30d26-c1e9-4721-ab6b-f0e1fd99f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b30d26-c1e9-4721-ab6b-f0e1fd99f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d5a197-e26c-495b-afd0-53118babb862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:28 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Volume 2c8b76cd-20ce-421f-bdeb-28a188899e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d', 'volume_size': 1} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:28 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5" returned: 0 in 0.645s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:25:28 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Converted 1024.00 MB image at 463.96 MB/s Apr 17 16:25:28 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 is being set with open permissions: ugo+rw Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:28 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 Apr 17 16:25:28 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:28 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840" returned: 0 in 0.415s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-00642521-df85-4f38-a1c9-e939851ec840" released by "_copy_volume_from_snapshot" :: held 4.353s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-1285822e-a8c6-449c-8d80-3c414af3f350-00642521-df85-4f38-a1c9-e939851ec840" released by "_create_volume_from_snapshot" :: held 4.369s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.377s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-174121451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8b76cd-20ce-421f-bdeb-28a188899e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8eec02270284f93af533ba2f83a681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:28Z,use_quota=True,user_id='6cc6ebb4bc914216af8c847f7927bd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Creating volume 2c8b76cd-20ce-421f-bdeb-28a188899e5d {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:28 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:28 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d 1073741824 Apr 17 16:25:28 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b756d89-b170-4a88-84a6-60335758d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00642521-df85-4f38-a1c9-e939851ec840', 'volume_size': 1, 'snapshot_id': '1285822e-a8c6-449c-8d80-3c414af3f350'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e556b82a-7da2-47fd-9cdb-8ba749a93c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:28 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Volume volume-00642521-df85-4f38-a1c9-e939851ec840 (00642521-df85-4f38-a1c9-e939851ec840): created successfully Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e556b82a-7da2-47fd-9cdb-8ba749a93c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:28 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Flow 'volume_create_manager' (60729838-2490-45ec-8f2e-f7e1aab489d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:28 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-aa62103d-937f-4e14-ad12-798da039e821 tempest-VolumesDeleteCascade-1805170858 None] Created volume successfully. Apr 17 16:25:29 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d 1073741824" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:29 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d Apr 17 16:25:29 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-ca76f30c-0cc4-4a83-9363-f32481422fd5-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-ca76f30c-0cc4-4a83-9363-f32481422fd5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Performing cascade delete. {{(pid=82061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-1285822e-a8c6-449c-8d80-3c414af3f350-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-1285822e-a8c6-449c-8d80-3c414af3f350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:29 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-ca76f30c-0cc4-4a83-9363-f32481422fd5" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d" returned: 0 in 0.452s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-ca76f30c-0cc4-4a83-9363-f32481422fd5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-1285822e-a8c6-449c-8d80-3c414af3f350" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d5a197-e26c-495b-afd0-53118babb862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b3b08e-4f49-4602-8d60-1e0c80d76e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-1285822e-a8c6-449c-8d80-3c414af3f350" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Deleting offline snapshot 1285822e-a8c6-449c-8d80-3c414af3f350 of volume ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] snapshot_file for this snap is: volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:25:29 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Volume volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d (2c8b76cd-20ce-421f-bdeb-28a188899e5d): created successfully Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b3b08e-4f49-4602-8d60-1e0c80d76e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Flow 'volume_create_manager' (e6692283-9dce-4728-9c0d-fbc8e3665e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b91c1-743e-49ca-b88c-c49fc03820ce]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:29 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fae866be-763d-4b7e-8128-f42a344c4320 tempest-VolumeQuotasAdminTestJSON-1799839272 None] Created volume successfully. Apr 17 16:25:29 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 Apr 17 16:25:29 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:30 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350" returned: 0 in 0.473s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca76f30c-0cc4-4a83-9363-f32481422fd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c10ad-754b-4540-abc8-ea6596d16235]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:30 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 Apr 17 16:25:30 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Acquiring lock "cinder-2c8b76cd-20ce-421f-bdeb-28a188899e5d-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "cinder-2c8b76cd-20ce-421f-bdeb-28a188899e5d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Acquiring lock "cinder-quobyte-2c8b76cd-20ce-421f-bdeb-28a188899e5d" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "cinder-quobyte-2c8b76cd-20ce-421f-bdeb-28a188899e5d" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b047e0d-3f66-484c-ab59-4cef814ff77e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:30 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d Apr 17 16:25:30 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:30 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5" returned: 0 in 0.495s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:30 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 Apr 17 16:25:30 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:30 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:30 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d Apr 17 16:25:30 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:31 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:31 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350 Apr 17 16:25:31 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:31 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c8b76cd-20ce-421f-bdeb-28a188899e5d" returned: 0 in 0.417s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "cinder-quobyte-2c8b76cd-20ce-421f-bdeb-28a188899e5d" released by "delete_volume" :: held 0.928s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Created reservations ['415fe1f1-4300-48da-bce4-3b344e142921', '8608a5cf-edac-4634-96b7-0bcef3e39c49', '1ae45f09-ff22-4ac2-a87c-940d636b38de', '141d7337-01bd-459e-a2f8-ade4c6972b49'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:31 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:31 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:31 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5.1285822e-a8c6-449c-8d80-3c414af3f350" returned: 0 in 0.475s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-1285822e-a8c6-449c-8d80-3c414af3f350" released by "_delete_snapshot" :: held 1.946s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-ca76f30c-0cc4-4a83-9363-f32481422fd5" released by "delete_snapshot" :: held 1.970s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Flow 'volume_create_manager' (74bf3dc7-3a57-4858-ad52-2b3005e1f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe76a56-64db-4f3f-aa27-95f80c5c8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe76a56-64db-4f3f-aa27-95f80c5c8953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-727448660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fea9c2c-aaca-4126-8156-46fae88f0797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8eec02270284f93af533ba2f83a681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:32Z,use_quota=True,user_id='6cc6ebb4bc914216af8c847f7927bd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e83ad0-a6a5-474d-bc10-36505f59624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e83ad0-a6a5-474d-bc10-36505f59624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b1ed03-5b38-470a-a5a7-2aa23f748567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b1ed03-5b38-470a-a5a7-2aa23f748567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fea9c2c-aaca-4126-8156-46fae88f0797', 'volume_name': 'volume-9fea9c2c-aaca-4126-8156-46fae88f0797', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a45838-a1b5-47b4-bffd-e005677ddb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a45838-a1b5-47b4-bffd-e005677ddb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd269e29-a39d-4f8e-836d-2dbb4dec8c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:31 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Volume 9fea9c2c-aaca-4126-8156-46fae88f0797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fea9c2c-aaca-4126-8156-46fae88f0797', 'volume_size': 1} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-727448660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fea9c2c-aaca-4126-8156-46fae88f0797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8eec02270284f93af533ba2f83a681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:32Z,use_quota=True,user_id='6cc6ebb4bc914216af8c847f7927bd6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Creating volume 9fea9c2c-aaca-4126-8156-46fae88f0797 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:31 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:31 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 1073741824 Apr 17 16:25:31 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Created reservations ['19a4e4fc-bc22-44e9-bfef-0ebb54ac07e2', 'e30273f3-b1a2-4289-9f6f-99e0d7edd0f1', 'dc1c7356-e51d-4dd5-97db-9c0f042331b2', '17f1169f-276a-46d7-b0d5-887ee817218e'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Delete snapshot completed successfully. Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-1285822e-a8c6-449c-8d80-3c414af3f350-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Snapshots deleted, issuing volume delete {{(pid=82061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-ca76f30c-0cc4-4a83-9363-f32481422fd5" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:31 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-ca76f30c-0cc4-4a83-9363-f32481422fd5" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Deleted volume successfully. Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e92b2c-fb98-448e-9cb1-1879b866cdda]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0b2bc56d-fee9-4cbd-93e3-ab20089167fb tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "cinder-2c8b76cd-20ce-421f-bdeb-28a188899e5d-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:31 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 Apr 17 16:25:31 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:32 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 1073741824" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:32 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 Apr 17 16:25:32 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:32 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5" returned: 0 in 0.494s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:32 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5 Apr 17 16:25:32 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:32 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797" returned: 0 in 0.405s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd269e29-a39d-4f8e-836d-2dbb4dec8c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fea9c2c-aaca-4126-8156-46fae88f0797', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235a1c6e-8a86-4a4d-828b-f018d7b2fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:32 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Volume volume-9fea9c2c-aaca-4126-8156-46fae88f0797 (9fea9c2c-aaca-4126-8156-46fae88f0797): created successfully Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235a1c6e-8a86-4a4d-828b-f018d7b2fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Flow 'volume_create_manager' (74bf3dc7-3a57-4858-ad52-2b3005e1f744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:32 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b0de4736-48e9-4ce7-a53d-50833c96b7fa tempest-VolumeQuotasAdminTestJSON-1799839272 None] Created volume successfully. Apr 17 16:25:32 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-ca76f30c-0cc4-4a83-9363-f32481422fd5" returned: 0 in 0.429s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-ca76f30c-0cc4-4a83-9363-f32481422fd5" released by "delete_volume" :: held 0.955s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Created reservations ['d15f1567-03f1-4746-87bb-255ff12e8462', 'ed162922-0754-4ed0-87a2-b869fae87cc7', '6129360a-ea17-4ad2-9885-9522f45b55bf', 'a04c2009-f322-4f09-bc11-82fc924dc854'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:32 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:32 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:33 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.394s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Deleted volume successfully. Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5a301065-41f7-4de3-a933-6cabf9831e96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-ca76f30c-0cc4-4a83-9363-f32481422fd5-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:33 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:33 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-00642521-df85-4f38-a1c9-e939851ec840-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-00642521-df85-4f38-a1c9-e939851ec840-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "cinder-quobyte-00642521-df85-4f38-a1c9-e939851ec840" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-00642521-df85-4f38-a1c9-e939851ec840" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f371a1-69ac-450d-aed6-002fdd8bb12e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:33 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 Apr 17 16:25:33 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:34 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-adaa6662-98ca-4b96-8792-a33903fc9a02 tempest-VolumeQuotasAdminTestJSON-1022831368 None] Transfer volume completed successfully. Apr 17 16:25:34 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.488s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:34 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:34 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840 Apr 17 16:25:34 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Acquiring lock "cinder-9fea9c2c-aaca-4126-8156-46fae88f0797-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Lock "cinder-9fea9c2c-aaca-4126-8156-46fae88f0797-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:34 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Acquiring lock "cinder-quobyte-9fea9c2c-aaca-4126-8156-46fae88f0797" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-00642521-df85-4f38-a1c9-e939851ec840" returned: 0 in 0.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Lock "cinder-quobyte-9fea9c2c-aaca-4126-8156-46fae88f0797" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-quobyte-00642521-df85-4f38-a1c9-e939851ec840" released by "delete_volume" :: held 0.994s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01568a1-d115-480a-a349-d3fa1d0f080e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Created reservations ['2b08e411-8f40-437b-b78e-7809da5359e5', 'e4da39c6-d5c6-449c-95c9-ba8b24280198', '9b60922f-ef1a-4b06-9a21-1379919fcd1d', 'aef9b760-1801-45f7-8522-d6d329303c24'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:34 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 Apr 17 16:25:34 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:35 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:35 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:35 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.414s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:35 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Deleted volume successfully. Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797" returned: 0 in 0.504s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b181c11e-783b-46b8-ae35-5c545e930f96 tempest-VolumesDeleteCascade-1805170858 None] Lock "cinder-00642521-df85-4f38-a1c9-e939851ec840-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:35 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797 Apr 17 16:25:35 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:35 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-9fea9c2c-aaca-4126-8156-46fae88f0797" returned: 0 in 0.416s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Lock "cinder-quobyte-9fea9c2c-aaca-4126-8156-46fae88f0797" released by "delete_volume" :: held 0.944s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Created reservations ['368f1f9b-1dc8-415d-86fe-193a7096025a', '1327b5fe-cc0c-4d0e-b3c9-aa47683bd006', '229a5f4c-5521-4d97-861a-8502d3a5f31a', 'd00e63b9-879b-4fb3-8f02-b03e59532505'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:35 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:35 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:36 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.470s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:36 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:36 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Deleted volume successfully. Apr 17 16:25:36 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cbf8b660-0989-460d-970c-7d3d33dc7738 tempest-VolumeQuotasAdminTestJSON-1109231899 None] Lock "cinder-9fea9c2c-aaca-4126-8156-46fae88f0797-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Flow 'volume_create_manager' (b70f0485-6bb6-4e90-8146-74df006eb584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc457ae-4a7e-46b9-8047-78552b51aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc457ae-4a7e-46b9-8047-78552b51aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1656441513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b427528f-0e5f-43fd-b3c5-20cb0af51b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3ec71019594c669daf558d394d138d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:39Z,use_quota=True,user_id='74f0138786e441c4aaadc0ea84df234a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c06077c-e7ec-4680-9012-51c412f5ea7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c06077c-e7ec-4680-9012-51c412f5ea7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a861832c-90a8-4c62-9b33-b465cfd095a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a861832c-90a8-4c62-9b33-b465cfd095a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b427528f-0e5f-43fd-b3c5-20cb0af51b21', 'volume_name': 'volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6644034c-24bf-4424-a29a-3addd089f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6644034c-24bf-4424-a29a-3addd089f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ce650c-0373-4312-9e3c-5ed3b0731ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Volume b427528f-0e5f-43fd-b3c5-20cb0af51b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21', 'volume_size': 1} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1656441513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b427528f-0e5f-43fd-b3c5-20cb0af51b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3ec71019594c669daf558d394d138d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:39Z,use_quota=True,user_id='74f0138786e441c4aaadc0ea84df234a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Creating volume b427528f-0e5f-43fd-b3c5-20cb0af51b21 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:38 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:39 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 1073741824 Apr 17 16:25:39 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:39 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 1073741824" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:39 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 Apr 17 16:25:39 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:40 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21" returned: 0 in 0.497s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ce650c-0373-4312-9e3c-5ed3b0731ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f604b9-3168-45c0-b617-3c3ea1a3c35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:40 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Volume volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 (b427528f-0e5f-43fd-b3c5-20cb0af51b21): created successfully Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f604b9-3168-45c0-b617-3c3ea1a3c35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Flow 'volume_create_manager' (b70f0485-6bb6-4e90-8146-74df006eb584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:40 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d6e85de2-5e67-4189-85cc-ac2cbc7c3a8a tempest-VolumesTransfersTest-1624522652 None] Created volume successfully. Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Flow 'volume_create_manager' (3bbfd6ba-f7f1-4bd6-b1ad-39cc9a27e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb85ebd-6d18-4445-bced-d6bdc31590c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb85ebd-6d18-4445-bced-d6bdc31590c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-791242939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c518b7-33db-45dd-99f4-dca62ff84fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b296b818de434ea416f2e995dc169d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:40Z,use_quota=True,user_id='d02c445b1c824b5a9756e5adb78f2fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6be5b94-02a6-4e54-889a-ca89d925b855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6be5b94-02a6-4e54-889a-ca89d925b855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0f7196-e3e0-43a0-b163-eb014901c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0f7196-e3e0-43a0-b163-eb014901c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c518b7-33db-45dd-99f4-dca62ff84fc5', 'volume_name': 'volume-94c518b7-33db-45dd-99f4-dca62ff84fc5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09e2a4-167e-4576-986a-d6fa33f57479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09e2a4-167e-4576-986a-d6fa33f57479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de41a3ec-4a6b-49e1-8707-ce3f43a8044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:40 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Volume 94c518b7-33db-45dd-99f4-dca62ff84fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c518b7-33db-45dd-99f4-dca62ff84fc5', 'volume_size': 1} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-791242939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c518b7-33db-45dd-99f4-dca62ff84fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b296b818de434ea416f2e995dc169d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:40Z,use_quota=True,user_id='d02c445b1c824b5a9756e5adb78f2fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Creating volume 94c518b7-33db-45dd-99f4-dca62ff84fc5 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:40 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:40 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 1073741824 Apr 17 16:25:40 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:40 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 1073741824" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:40 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 Apr 17 16:25:40 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:41 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de41a3ec-4a6b-49e1-8707-ce3f43a8044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c518b7-33db-45dd-99f4-dca62ff84fc5', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7b84d3-ca68-4b90-8758-fbbc1792b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:41 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Volume volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 (94c518b7-33db-45dd-99f4-dca62ff84fc5): created successfully Apr 17 16:25:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7b84d3-ca68-4b90-8758-fbbc1792b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Flow 'volume_create_manager' (3bbfd6ba-f7f1-4bd6-b1ad-39cc9a27e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b5f95638-5df5-4620-abb0-aec39979e47a tempest-VolumesServicesTestJSON-1470939446 None] Created volume successfully. Apr 17 16:25:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7f7f39d4-e8ac-4cd6-8ee2-ed983b5b47c4 tempest-VolumesTransfersTest-326114803 None] Transfer volume completed successfully. Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Acquiring lock "cinder-b427528f-0e5f-43fd-b3c5-20cb0af51b21-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-b427528f-0e5f-43fd-b3c5-20cb0af51b21-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Acquiring lock "cinder-quobyte-b427528f-0e5f-43fd-b3c5-20cb0af51b21" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-quobyte-b427528f-0e5f-43fd-b3c5-20cb0af51b21" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e2ec8b-8452-45dd-ba70-9ad925a8614f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:42 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 Apr 17 16:25:42 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Acquiring lock "cinder-94c518b7-33db-45dd-99f4-dca62ff84fc5-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Lock "cinder-94c518b7-33db-45dd-99f4-dca62ff84fc5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Acquiring lock "cinder-quobyte-94c518b7-33db-45dd-99f4-dca62ff84fc5" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Lock "cinder-quobyte-94c518b7-33db-45dd-99f4-dca62ff84fc5" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[073344b0-ac00-46d4-8aad-9ab844a6cc99]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:42 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 Apr 17 16:25:42 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:42 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21" returned: 0 in 0.492s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:42 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21 Apr 17 16:25:42 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:43 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:43 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5 Apr 17 16:25:43 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:43 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b427528f-0e5f-43fd-b3c5-20cb0af51b21" returned: 0 in 0.421s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-quobyte-b427528f-0e5f-43fd-b3c5-20cb0af51b21" released by "delete_volume" :: held 0.936s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Created reservations ['f7e1122b-e404-4d86-a068-813660a023fb', '2f3e325e-618f-4a3f-acb3-e2dfe35055e2', 'dedb283f-ca7e-4c5f-979b-b186255db175', '142091c9-b38d-4579-be27-cd068bfe0fd1'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:43 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:43 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:43 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94c518b7-33db-45dd-99f4-dca62ff84fc5" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Lock "cinder-quobyte-94c518b7-33db-45dd-99f4-dca62ff84fc5" released by "delete_volume" :: held 0.951s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Created reservations ['f7a025e1-5f25-4a01-a52b-23000f21b43f', '32a3745f-58d6-4653-98ec-903fa7609c36', 'd66242a9-d564-48ad-af23-926b7435d350', '3ea55e3a-fe18-46e3-921e-bb468a0137ea'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:43 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:43 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:43 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:43 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Deleted volume successfully. Apr 17 16:25:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-58a36656-c401-4427-a73e-d1cf6eda5efc tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-b427528f-0e5f-43fd-b3c5-20cb0af51b21-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:44 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:44 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Deleted volume successfully. Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7d7c4c80-c4bc-4db8-8aab-97b5daaa1afb tempest-VolumesServicesTestJSON-1470939446 None] Lock "cinder-94c518b7-33db-45dd-99f4-dca62ff84fc5-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Flow 'volume_create_manager' (7a331ccd-9a03-48a6-9e73-ebc1dd2d90ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2592f5a7-2f61-4f23-a3f2-ddc4348f2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2592f5a7-2f61-4f23-a3f2-ddc4348f2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-405405235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f115d6cc-61a5-4d58-81b3-99a06e4705e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3ec71019594c669daf558d394d138d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:45Z,use_quota=True,user_id='74f0138786e441c4aaadc0ea84df234a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdba4895-c0da-45f2-ac20-65829c7853b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdba4895-c0da-45f2-ac20-65829c7853b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3307eec2-dc89-49a2-aa3e-f12cf814d886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3307eec2-dc89-49a2-aa3e-f12cf814d886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f115d6cc-61a5-4d58-81b3-99a06e4705e7', 'volume_name': 'volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a116824-34af-40d4-bbfa-abd3d5e61141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a116824-34af-40d4-bbfa-abd3d5e61141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98bba09-2a97-42df-ad1c-29756eba23d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:44 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Volume f115d6cc-61a5-4d58-81b3-99a06e4705e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7', 'volume_size': 1} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-405405235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f115d6cc-61a5-4d58-81b3-99a06e4705e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3ec71019594c669daf558d394d138d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:45Z,use_quota=True,user_id='74f0138786e441c4aaadc0ea84df234a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Creating volume f115d6cc-61a5-4d58-81b3-99a06e4705e7 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:44 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:44 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 1073741824 Apr 17 16:25:44 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:45 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 1073741824" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:45 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 Apr 17 16:25:45 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:45 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7" returned: 0 in 0.503s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98bba09-2a97-42df-ad1c-29756eba23d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fb5831-ee1e-4843-abeb-c9b4c6a0bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:45 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Volume volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 (f115d6cc-61a5-4d58-81b3-99a06e4705e7): created successfully Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fb5831-ee1e-4843-abeb-c9b4c6a0bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Flow 'volume_create_manager' (7a331ccd-9a03-48a6-9e73-ebc1dd2d90ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:45 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-45008ae9-bc25-4d83-94ff-470c5c74df9a tempest-VolumesTransfersTest-1624522652 None] Created volume successfully. Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Flow 'volume_create_manager' (90b2489b-a419-4e9b-90ec-4b03f1a309c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1303fae2-c730-46ca-b2bb-75824f76cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1303fae2-c730-46ca-b2bb-75824f76cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1954537555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e63079e-31d5-4480-b693-b5dcf746d979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac703a358d943debd1dd433ad1fe473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:46Z,use_quota=True,user_id='e74ecdd7fa7643e098010a0ecb833ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9482e7d7-9b76-4b54-b67f-6e46c1e00cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9482e7d7-9b76-4b54-b67f-6e46c1e00cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c566b1-47db-4ccc-bc2f-464c4ff286e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.image.glance [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Creating Keystone auth plugin from conf {{(pid=82061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c566b1-47db-4ccc-bc2f-464c4ff286e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e63079e-31d5-4480-b693-b5dcf746d979', 'volume_name': 'volume-0e63079e-31d5-4480-b693-b5dcf746d979', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939f71a4-0578-41f5-b61c-45715669c6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939f71a4-0578-41f5-b61c-45715669c6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1de60a4-5936-4d65-bab7-0446d23d0fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:46 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Volume 0e63079e-31d5-4480-b693-b5dcf746d979: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e63079e-31d5-4480-b693-b5dcf746d979', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Trying to clone 0e63079e-31d5-4480-b693-b5dcf746d979 from image 35106061-d1fb-4b07-851b-6be93771408f at location (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]). {{(pid=82061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 16:25:46 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Image download 20.69 MB at 20.69 MB/s Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d161b2-838b-4fe0-b427-15251a39a5c5]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:47 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD Apr 17 16:25:47 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Acquiring lock "cinder-f115d6cc-61a5-4d58-81b3-99a06e4705e7-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-f115d6cc-61a5-4d58-81b3-99a06e4705e7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Acquiring lock "cinder-quobyte-f115d6cc-61a5-4d58-81b3-99a06e4705e7" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-quobyte-f115d6cc-61a5-4d58-81b3-99a06e4705e7" acquired by "delete_volume" :: waited 0.022s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b66973b-33ed-40c4-b5bc-ae1f8be07b3b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:47 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 Apr 17 16:25:47 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:47 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f is fetched for user e74ecdd7fa7643e098010a0ecb833ab9. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[32352544-3fa6-4812-9e95-e846f628484c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:47 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD Apr 17 16:25:47 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:47 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:47 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7 Apr 17 16:25:47 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:47 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1954537555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e63079e-31d5-4480-b693-b5dcf746d979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac703a358d943debd1dd433ad1fe473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:46Z,use_quota=True,user_id='e74ecdd7fa7643e098010a0ecb833ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Creating volume 0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:47 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:48 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 1073741824 Apr 17 16:25:48 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:48 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f115d6cc-61a5-4d58-81b3-99a06e4705e7" returned: 0 in 0.403s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-quobyte-f115d6cc-61a5-4d58-81b3-99a06e4705e7" released by "delete_volume" :: held 0.914s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Created reservations ['e7c5da63-cf9a-4029-aa09-e24d5c3e78ee', '3753fdec-ac1a-4526-8725-b0a10431ba32', '0cce4a03-0e49-4cc9-8ace-933a335257d1', '712c7e87-baed-4002-b0ea-117cf5f3a841'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:48 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:48 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:48 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 1073741824" returned: 0 in 0.553s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:48 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 Apr 17 16:25:48 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:48 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:48 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Deleted volume successfully. Apr 17 16:25:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-ed00c7d5-4930-45f7-9549-4d3fd7c979f9 tempest-VolumesTransfersTest-1701800143 None] Lock "cinder-f115d6cc-61a5-4d58-81b3-99a06e4705e7-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:49 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Attempting download of 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume 0e63079e-31d5-4480-b693-b5dcf746d979. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb533812-faa7-4f83-a3e0-89fef860350b]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_b0jmjxdx {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:49 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_b0jmjxdx Apr 17 16:25:49 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:49 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_b0jmjxdx" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_b0jmjxdx {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:49 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_b0jmjxdx Apr 17 16:25:49 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:50 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_b0jmjxdx" returned: 1 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_b0jmjxdx' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:25:50 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c159c18-009e-4d64-9354-8d456c27ccdd]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:50 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD Apr 17 16:25:50 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:50 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:50 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] 35106061-d1fb-4b07-851b-6be93771408f was qcow2, converting to raw {{(pid=82061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 16:25:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:50 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 Apr 17 16:25:50 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:51 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979" returned: 0 in 0.949s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_tnnlpaqvdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:25:51 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Converted 112.00 MB image at 112.00 MB/s Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:51 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 1G Apr 17 16:25:51 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Flow 'volume_create_manager' (34b02353-cba1-4f67-8fcc-c6418c0ca677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa42df6-38f5-42d5-9aed-e65efbd8716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa42df6-38f5-42d5-9aed-e65efbd8716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-984135344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04648b1791f940d3870ed7aba0e14f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:52Z,use_quota=True,user_id='5711b7d88d0a4ae58c3dc4fe30f987c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06985941-3de8-4d43-adb2-f2a7b79e0252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06985941-3de8-4d43-adb2-f2a7b79e0252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8c0403-7ded-4e9c-a494-35e2b4cec18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8c0403-7ded-4e9c-a494-35e2b4cec18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb', 'volume_name': 'volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13c9808-aa83-44de-8b45-c614a02c58e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13c9808-aa83-44de-8b45-c614a02c58e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7d2ca9-617b-46db-bfe1-8c94cd78b400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:51 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Volume fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb', 'volume_size': 1} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-984135344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04648b1791f940d3870ed7aba0e14f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:52Z,use_quota=True,user_id='5711b7d88d0a4ae58c3dc4fe30f987c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Creating volume fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:25:51 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:25:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:51 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb 1073741824 Apr 17 16:25:51 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:52 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 1G" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c492561d-8775-4da5-a69f-b954a9b5d7db]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:52 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 Apr 17 16:25:52 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:52 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb 1073741824" returned: 0 in 0.500s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:52 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb Apr 17 16:25:52 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:52 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979" returned: 0 in 0.490s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:52 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 Apr 17 16:25:52 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:52 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" returned: 0 in 0.435s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7d2ca9-617b-46db-bfe1-8c94cd78b400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2246fff3-9ee0-4865-bdd9-f74a6f1c5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:52 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Volume volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb (fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb): created successfully Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2246fff3-9ee0-4865-bdd9-f74a6f1c5014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:52 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Flow 'volume_create_manager' (34b02353-cba1-4f67-8fcc-c6418c0ca677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:52 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a4a74ade-ab14-4c33-a965-3a487f22a40f tempest-VolumesCloneTest-1593013905 None] Created volume successfully. Apr 17 16:25:53 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979" returned: 1 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Downloaded image 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume 0e63079e-31d5-4480-b693-b5dcf746d979 successfully. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f for user e74ecdd7fa7643e098010a0ecb833ab9 is deleted. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Marking volume 0e63079e-31d5-4480-b693-b5dcf746d979 as bootable. {{(pid=82061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Copying metadata from image 35106061-d1fb-4b07-851b-6be93771408f to 0e63079e-31d5-4480-b693-b5dcf746d979. {{(pid=82061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Creating volume glance metadata for volume 0e63079e-31d5-4480-b693-b5dcf746d979 backed by image 35106061-d1fb-4b07-851b-6be93771408f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1de60a4-5936-4d65-bab7-0446d23d0fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e63079e-31d5-4480-b693-b5dcf746d979', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01aa3eb-366e-4cca-a23b-76165890b2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:53 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Volume volume-0e63079e-31d5-4480-b693-b5dcf746d979 (0e63079e-31d5-4480-b693-b5dcf746d979): created successfully Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01aa3eb-366e-4cca-a23b-76165890b2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Flow 'volume_create_manager' (90b2489b-a419-4e9b-90ec-4b03f1a309c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:53 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-42c6c5fb-d711-4314-930e-a60bbb6657d0 tempest-VolumesImageMetadata-1132603962 None] Created volume successfully. Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Flow 'volume_create_manager' (1118c8e4-f75b-48de-9d91-259e1d7cae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a11fd8c-eb35-4cc9-9b91-5385dbdb3a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a11fd8c-eb35-4cc9-9b91-5385dbdb3a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1744492951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67db61a-f178-4acc-b086-0912d30a9017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04648b1791f940d3870ed7aba0e14f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:54Z,use_quota=True,user_id='5711b7d88d0a4ae58c3dc4fe30f987c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e97d9-80ea-433a-bb26-dc89eeeda54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e97d9-80ea-433a-bb26-dc89eeeda54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290d1644-527c-42e6-a78e-6f469208f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290d1644-527c-42e6-a78e-6f469208f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f67db61a-f178-4acc-b086-0912d30a9017', 'volume_name': 'volume-f67db61a-f178-4acc-b086-0912d30a9017', 'volume_size': 2, 'source_volid': 'fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ff169c-9fd2-4566-b784-ae0c8a6b7408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ff169c-9fd2-4566-b784-ae0c8a6b7408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30149a6-22e9-41f0-95fa-2163282e0137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Volume f67db61a-f178-4acc-b086-0912d30a9017: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f67db61a-f178-4acc-b086-0912d30a9017', 'volume_size': 2, 'source_volid': 'fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb', 'source_volstatus': 'available'} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:54 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Cloning volume fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb to volume f67db61a-f178-4acc-b086-0912d30a9017 Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Creating offline snapshot 0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd of volume fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Acquiring lock "cinder-0e63079e-31d5-4480-b693-b5dcf746d979-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[87add3f2-3bc7-409a-bf5f-0be855c64e8c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Lock "cinder-0e63079e-31d5-4480-b693-b5dcf746d979-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Acquiring lock "cinder-quobyte-0e63079e-31d5-4480-b693-b5dcf746d979" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Lock "cinder-quobyte-0e63079e-31d5-4480-b693-b5dcf746d979" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb280e3f-2daa-469b-80ac-b48d0b003a0f]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:54 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb Apr 17 16:25:54 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:54 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 Apr 17 16:25:54 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:54 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:54 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd 1G Apr 17 16:25:54 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:54 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:54 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 Apr 17 16:25:54 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:55 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd 1G" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:55 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd Apr 17 16:25:55 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:55 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979" returned: 1 in 0.519s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:55 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979 Apr 17 16:25:55 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:55 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" returned: 0 in 0.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:55 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd is being set with open permissions: ugo+rw Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:55 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd Apr 17 16:25:55 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:55 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-0e63079e-31d5-4480-b693-b5dcf746d979" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Lock "cinder-quobyte-0e63079e-31d5-4480-b693-b5dcf746d979" released by "delete_volume" :: held 1.503s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Created reservations ['c4081202-e140-49c9-a53d-c32a8f3b9e45', '44cd8796-c60b-4fbd-87dc-6778f9206e57', '4d751ec8-5fdb-4a0c-835f-6ef7a4f78389', '4415dd7d-1f74-4896-9964-e1e4402164a0'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:55 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:25:55 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:56 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:56 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.info Apr 17 16:25:56 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:56 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:56 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:25:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Deleted volume successfully. Apr 17 16:25:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-8a13afa6-3c8d-415c-80fd-702bf98583a0 tempest-VolumesImageMetadata-1132603962 None] Lock "cinder-0e63079e-31d5-4480-b693-b5dcf746d979-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:25:56 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.info" returned: 0 in 0.490s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:56 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.info is being set with open permissions: ugo+rw Apr 17 16:25:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:56 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.info Apr 17 16:25:56 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:57 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.info" returned: 0 in 0.453s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "cinder-quobyte-f67db61a-f178-4acc-b086-0912d30a9017" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-f67db61a-f178-4acc-b086-0912d30a9017" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] snapshot: 0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd, volume: f67db61a-f178-4acc-b086-0912d30a9017, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9aa197-8f2d-419b-86ea-6d6a6f3c8001]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:57 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd Apr 17 16:25:57 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:57 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6f058-edbd-4406-b93a-e6aab771f996]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:25:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:57 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb Apr 17 16:25:57 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:58 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" returned: 0 in 0.490s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:25:58 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 Apr 17 16:25:58 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Flow 'volume_create_manager' (d3e44b56-7739-479c-93f0-216e01d30cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cd0341-5ee8-458c-8a95-8e3e79bde009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cd0341-5ee8-458c-8a95-8e3e79bde009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1480778844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c633d4d-f09b-4604-84fc-0629f094aeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b66bafb12b14645ba45d4125e397a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:58Z,use_quota=True,user_id='a04148aedfaf44d988640eccdf830f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0380f491-05a3-404d-abe5-33ced607a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0380f491-05a3-404d-abe5-33ced607a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28d74ed-9aa7-4d82-99f6-4b10c4c58815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28d74ed-9aa7-4d82-99f6-4b10c4c58815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c633d4d-f09b-4604-84fc-0629f094aeee', 'volume_name': 'volume-2c633d4d-f09b-4604-84fc-0629f094aeee', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb81651-4619-4d8b-8ed2-50a6aeb28a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb81651-4619-4d8b-8ed2-50a6aeb28a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5948e925-9367-4dd8-a7c9-fede3c364e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:25:58 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Volume 2c633d4d-f09b-4604-84fc-0629f094aeee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c633d4d-f09b-4604-84fc-0629f094aeee', 'volume_size': 1} Apr 17 16:25:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:00 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017" returned: 0 in 2.135s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:00 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebae00-0645-4c5f-8ca1-b32ec9d758c4]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:00 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb Apr 17 16:26:00 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:00 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" returned: 0 in 0.598s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:00 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb, size 1024.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:26:00 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Converted 1024.00 MB image at 479.35 MB/s Apr 17 16:26:00 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 is being set with open permissions: ugo+rw Apr 17 16:26:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:00 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 Apr 17 16:26:00 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:01 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017" returned: 0 in 0.413s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-f67db61a-f178-4acc-b086-0912d30a9017" released by "_copy_volume_from_snapshot" :: held 4.215s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "cinder-quobyte-0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Deleting offline snapshot 0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd of volume fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] snapshot_file for this snap is: volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6dba7c-6a77-457b-9954-7c6d06e30faa]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:01 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd Apr 17 16:26:01 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:01 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" returned: 0 in 0.476s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f800c1-7ee5-4870-8a28-238fad50a845]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:01 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb Apr 17 16:26:01 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:02 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:02 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd Apr 17 16:26:02 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:02 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" returned: 0 in 0.480s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:02 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd Apr 17 16:26:02 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:03 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb.0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" returned: 0 in 0.398s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-0e74a9cf-9ba9-48c3-9d79-a37a50e0dbfd" released by "_delete_snapshot" :: held 1.877s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=173,cinder:UPDATE=241,cinder:INSERT=63,cinder:DELETE=16 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=167,cinder:INSERT=60,cinder:UPDATE=182,cinder:DELETE=16 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.075s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.656s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1480778844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c633d4d-f09b-4604-84fc-0629f094aeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b66bafb12b14645ba45d4125e397a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:25:58Z,use_quota=True,user_id='a04148aedfaf44d988640eccdf830f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Creating volume 2c633d4d-f09b-4604-84fc-0629f094aeee {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:03 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30149a6-22e9-41f0-95fa-2163282e0137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67db61a-f178-4acc-b086-0912d30a9017', 'volume_size': 2, 'source_volid': 'fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd4d901-9df7-40b7-a1d0-087a4a2ab49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:03 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee 1073741824 Apr 17 16:26:03 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Volume volume-f67db61a-f178-4acc-b086-0912d30a9017 (f67db61a-f178-4acc-b086-0912d30a9017): created successfully Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd4d901-9df7-40b7-a1d0-087a4a2ab49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Flow 'volume_create_manager' (1118c8e4-f75b-48de-9d91-259e1d7cae2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b10a3188-1864-4b55-ba89-15703998fa81 tempest-VolumesCloneTest-1593013905 None] Created volume successfully. Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "cinder-f67db61a-f178-4acc-b086-0912d30a9017-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-f67db61a-f178-4acc-b086-0912d30a9017-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "cinder-quobyte-f67db61a-f178-4acc-b086-0912d30a9017" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-f67db61a-f178-4acc-b086-0912d30a9017" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b9d9e8-d463-41fd-b246-85d758d76f97]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:03 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee 1073741824" returned: 0 in 0.569s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:03 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee Apr 17 16:26:03 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:03 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 Apr 17 16:26:03 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:04 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee" returned: 0 in 0.399s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5948e925-9367-4dd8-a7c9-fede3c364e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c633d4d-f09b-4604-84fc-0629f094aeee', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b7ee7a-1332-4932-875d-cc3787c3fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:04 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Volume volume-2c633d4d-f09b-4604-84fc-0629f094aeee (2c633d4d-f09b-4604-84fc-0629f094aeee): created successfully Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b7ee7a-1332-4932-875d-cc3787c3fefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Flow 'volume_create_manager' (d3e44b56-7739-479c-93f0-216e01d30cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:04 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017" returned: 0 in 0.470s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:04 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c752fd70-4314-4912-8560-bb1d3093331e tempest-AbsoluteLimitsTests-2147158954 None] Created volume successfully. Apr 17 16:26:04 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017 Apr 17 16:26:04 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:04 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-f67db61a-f178-4acc-b086-0912d30a9017" returned: 0 in 0.399s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-f67db61a-f178-4acc-b086-0912d30a9017" released by "delete_volume" :: held 0.889s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Created reservations ['ea555394-8ca1-40b8-9125-245cbe7869f3', '155749bc-7301-4ef9-8a16-1f8c2cef7ab9', '2b08dbee-507a-47a6-82a8-c9666d0d5512', '811b9927-8406-46e7-a7b9-e4c89e63078c'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:04 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:04 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "cinder-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Acquiring lock "cinder-2c633d4d-f09b-4604-84fc-0629f094aeee-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Lock "cinder-2c633d4d-f09b-4604-84fc-0629f094aeee-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "cinder-quobyte-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5fb5f4-2c70-4e1c-8da9-7cfa44f3845d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:04 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Acquiring lock "cinder-quobyte-2c633d4d-f09b-4604-84fc-0629f094aeee" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Lock "cinder-quobyte-2c633d4d-f09b-4604-84fc-0629f094aeee" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e703638a-01f5-4691-86a0-7f8a8e70f81e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:05 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb Apr 17 16:26:05 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:05 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee Apr 17 16:26:05 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:05 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:05 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Deleted volume successfully. Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-823276ce-8b50-4fbb-a092-a781ab7323b9 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-f67db61a-f178-4acc-b086-0912d30a9017-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:05 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" returned: 0 in 0.517s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:05 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee" returned: 0 in 0.480s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:05 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb Apr 17 16:26:05 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:05 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee Apr 17 16:26:05 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:05 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" returned: 0 in 0.430s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:05 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2c633d4d-f09b-4604-84fc-0629f094aeee" returned: 0 in 0.429s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-quobyte-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb" released by "delete_volume" :: held 0.982s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Lock "cinder-quobyte-2c633d4d-f09b-4604-84fc-0629f094aeee" released by "delete_volume" :: held 0.944s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:05 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Created reservations ['63e11d1e-51dd-4618-8eec-d88281bb72e0', 'f4381b4f-8bd9-4e83-ba9b-fc332d7c26e9', '8598d4f9-ed9d-4922-901c-084bfbc164b4', '2a1d5152-234d-4f93-a9ad-aecc15404526'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Created reservations ['e81fbf7c-359d-467f-8162-e26c36c22aae', 'f2286cc0-75b5-4568-8416-e535a7e6e7b0', '6def283c-85f1-4e81-81ee-ffc8ec1d0e90', '9cfe63c0-13c6-484f-bff8-28506f80915c'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:06 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:06 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:06 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:06 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:06 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.407s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Deleted volume successfully. Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-acd18abb-992f-447d-8261-6f94d0f4dbdb tempest-AbsoluteLimitsTests-2147158954 None] Lock "cinder-2c633d4d-f09b-4604-84fc-0629f094aeee-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:06 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.418s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Deleted volume successfully. Apr 17 16:26:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0192848a-38c8-48d1-b5ac-62c67b464d79 tempest-VolumesCloneTest-1593013905 None] Lock "cinder-fd1a5f2e-2da8-49cd-a18a-aecc86dffbfb-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Flow 'volume_create_manager' (2add8d5a-5a1a-4fb0-8b79-b136a35524f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d487ffb4-61ce-4fde-a00f-99177c5343a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d487ffb4-61ce-4fde-a00f-99177c5343a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-793852178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd32ffab-dae9-46e8-82d4-4f0b05d6a33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95633fbd6c374ce19f8433d1ed765860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:09Z,use_quota=True,user_id='8e54c79965a2481dab8cd1a7492f02f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80e3ac6-817d-4deb-b726-40be7331fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80e3ac6-817d-4deb-b726-40be7331fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73362b14-e4b9-4c35-a400-a08b7ef22d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.image.glance [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Creating Keystone auth plugin from conf {{(pid=82061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73362b14-e4b9-4c35-a400-a08b7ef22d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd32ffab-dae9-46e8-82d4-4f0b05d6a33f', 'volume_name': 'volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d0629f-8bf6-46a4-9249-02d636148b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d0629f-8bf6-46a4-9249-02d636148b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d79568-851b-411d-95d8-e67af8d22fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Volume fd32ffab-dae9-46e8-82d4-4f0b05d6a33f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Trying to clone fd32ffab-dae9-46e8-82d4-4f0b05d6a33f from image 35106061-d1fb-4b07-851b-6be93771408f at location (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]). {{(pid=82061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 16:26:09 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Image download 20.69 MB at 20.69 MB/s Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed281f3-327d-4d64-bdaf-539d738d7e3a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:09 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD Apr 17 16:26:09 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Flow 'volume_create_manager' (57ba11cc-82ab-4e0d-8b1f-439c77c57e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cd4ba6-36ed-475d-af08-5b1368ab2883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cd4ba6-36ed-475d-af08-5b1368ab2883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1000384736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770bbf1e-df47-4ed2-a56a-44fd4fd4cb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebce05659b8b467da5675c2ae78b8dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:10Z,use_quota=True,user_id='08ea4e2bd04a4883af2dadf5e86be5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b7bfc8-ff88-4ce8-97a1-ca4f37f45be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b7bfc8-ff88-4ce8-97a1-ca4f37f45be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495a7ed6-be2b-4710-b05b-9c85b79020d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495a7ed6-be2b-4710-b05b-9c85b79020d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770bbf1e-df47-4ed2-a56a-44fd4fd4cb64', 'volume_name': 'volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37882841-8119-4668-9bc8-299fc1be84d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37882841-8119-4668-9bc8-299fc1be84d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c23fb8-da9c-4ca6-98b6-daf238df04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:09 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Volume 770bbf1e-df47-4ed2-a56a-44fd4fd4cb64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64', 'volume_size': 1} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1000384736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770bbf1e-df47-4ed2-a56a-44fd4fd4cb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebce05659b8b467da5675c2ae78b8dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:10Z,use_quota=True,user_id='08ea4e2bd04a4883af2dadf5e86be5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Creating volume 770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:09 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:09 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 1073741824 Apr 17 16:26:09 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:10 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f is fetched for user 8e54c79965a2481dab8cd1a7492f02f7. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b856c8bd-24e9-43a9-b885-7eb38b376ecf]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:10 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD Apr 17 16:26:10 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:10 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 1073741824" returned: 0 in 0.556s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:10 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 Apr 17 16:26:10 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:10 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:10 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-793852178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd32ffab-dae9-46e8-82d4-4f0b05d6a33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95633fbd6c374ce19f8433d1ed765860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:09Z,use_quota=True,user_id='8e54c79965a2481dab8cd1a7492f02f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Creating volume fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:10 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c23fb8-da9c-4ca6-98b6-daf238df04b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:10 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 1073741824 Apr 17 16:26:10 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b8bf78-f5d9-42ce-a251-888c22e38b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:10 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Volume volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 (770bbf1e-df47-4ed2-a56a-44fd4fd4cb64): created successfully Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b8bf78-f5d9-42ce-a251-888c22e38b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Flow 'volume_create_manager' (57ba11cc-82ab-4e0d-8b1f-439c77c57e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:10 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-dd0678d5-d5c3-475a-861a-93a0d18333e1 tempest-VolumesMetadataTest-941385753 None] Created volume successfully. Apr 17 16:26:11 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 1073741824" returned: 0 in 0.517s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:11 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:11 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:11 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 0 in 0.409s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Attempting download of 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume fd32ffab-dae9-46e8-82d4-4f0b05d6a33f. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b20d5a-bfe5-4f73-98f8-27012b839731]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_j83qtc6u {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:11 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_j83qtc6u Apr 17 16:26:11 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Acquiring lock "cinder-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:12 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Lock "cinder-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_j83qtc6u" returned: 0 in 0.557s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_j83qtc6u {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Acquiring lock "cinder-quobyte-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Lock "cinder-quobyte-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[859abb88-7bc9-4c22-b842-30531f740476]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:12 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_j83qtc6u Apr 17 16:26:12 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:12 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 Apr 17 16:26:12 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:12 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_j83qtc6u" returned: 1 in 0.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35106061-d1fb-4b07-851b-6be93771408f_j83qtc6u' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e07f97-d854-4e1b-9033-6d57f5d28c92]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:12 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD Apr 17 16:26:12 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:12 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64" returned: 0 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:13 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64 Apr 17 16:26:13 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:13 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] 35106061-d1fb-4b07-851b-6be93771408f was qcow2, converting to raw {{(pid=82061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:13 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:13 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:13 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Lock "cinder-quobyte-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64" released by "delete_volume" :: held 0.949s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Created reservations ['489f1600-bbdb-4697-aa2f-6c89fd267580', '300e7c16-afc3-448c-bad8-42dfec85d57f', '5d753028-dbf6-4636-ae40-a5e346b1657e', 'de3870c1-7a01-416a-9c1f-a565c5fe1994'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:13 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:13 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:13 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:13 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Deleted volume successfully. Apr 17 16:26:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-44afee7a-7193-4288-b1f8-f8fac0a36e96 tempest-VolumesMetadataTest-941385753 None] Lock "cinder-770bbf1e-df47-4ed2-a56a-44fd4fd4cb64-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:14 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 0 in 0.990s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:14 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35106061-d1fb-4b07-851b-6be93771408f_niw6avj2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:26:14 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Converted 112.00 MB image at 112.00 MB/s Apr 17 16:26:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:14 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 1G Apr 17 16:26:14 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:14 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 1G" returned: 0 in 0.465s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:14 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f75ee84-d32d-425e-9451-1d6c558eb34c]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:14 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:14 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:15 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 0 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:15 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:15 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Flow 'volume_create_manager' (a646ebed-56db-459f-b83e-917ff49c12d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880369cb-8059-4bcd-b7ea-42a472d6d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880369cb-8059-4bcd-b7ea-42a472d6d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-752619749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd5ae78-0505-4edc-84b3-d3f1390670a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='106128b28e0b49c084911d49bc440697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:15Z,use_quota=True,user_id='32626755a5974fdeaf97f64735cfbfda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9880914e-53eb-40f3-9b17-d41b32e0292f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9880914e-53eb-40f3-9b17-d41b32e0292f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28410a6f-ed6a-431e-ab8e-2f34b480fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28410a6f-ed6a-431e-ab8e-2f34b480fd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd5ae78-0505-4edc-84b3-d3f1390670a7', 'volume_name': 'volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2deb6a1e-be32-4628-8ff5-29d481725398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2deb6a1e-be32-4628-8ff5-29d481725398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c8d2e1-9aa3-4731-abff-97bbe22e3fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:15 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Volume dfd5ae78-0505-4edc-84b3-d3f1390670a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7', 'volume_size': 1} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-752619749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd5ae78-0505-4edc-84b3-d3f1390670a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='106128b28e0b49c084911d49bc440697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:15Z,use_quota=True,user_id='32626755a5974fdeaf97f64735cfbfda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Creating volume dfd5ae78-0505-4edc-84b3-d3f1390670a7 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:15 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:15 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 1073741824 Apr 17 16:26:15 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:15 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 1 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Downloaded image 35106061-d1fb-4b07-851b-6be93771408f ((None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}])) to volume fd32ffab-dae9-46e8-82d4-4f0b05d6a33f successfully. {{(pid=82061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Temporary image 35106061-d1fb-4b07-851b-6be93771408f for user 8e54c79965a2481dab8cd1a7492f02f7 is deleted. {{(pid=82061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.volume_utils [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Marking volume fd32ffab-dae9-46e8-82d4-4f0b05d6a33f as bootable. {{(pid=82061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Copying metadata from image 35106061-d1fb-4b07-851b-6be93771408f to fd32ffab-dae9-46e8-82d4-4f0b05d6a33f. {{(pid=82061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Creating volume glance metadata for volume fd32ffab-dae9-46e8-82d4-4f0b05d6a33f backed by image 35106061-d1fb-4b07-851b-6be93771408f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d79568-851b-411d-95d8-e67af8d22fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f', 'volume_size': 1, 'image_id': '35106061-d1fb-4b07-851b-6be93771408f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35106061-d1fb-4b07-851b-6be93771408f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d7cb6d5a4940b4b5bb9c1baa89f67b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35106061-d1fb-4b07-851b-6be93771408f', 'created_at': datetime.datetime(2026, 4, 17, 14, 14, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 14, 14, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35106061-d1fb-4b07-851b-6be93771408f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1500035-9a67-4c4d-8a23-c87eae118197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:15 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Volume volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f (fd32ffab-dae9-46e8-82d4-4f0b05d6a33f): created successfully Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1500035-9a67-4c4d-8a23-c87eae118197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:15 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Flow 'volume_create_manager' (2add8d5a-5a1a-4fb0-8b79-b136a35524f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:15 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2472837b-7709-4197-b7ce-ecf0c7287d95 tempest-VolumesExtendTest-2143436365 None] Created volume successfully. Apr 17 16:26:16 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 1073741824" returned: 0 in 0.503s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:16 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 Apr 17 16:26:16 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:16 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7" returned: 0 in 0.400s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c8d2e1-9aa3-4731-abff-97bbe22e3fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f1e35e-350e-4a65-8d1f-fed2b594beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:16 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Volume volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 (dfd5ae78-0505-4edc-84b3-d3f1390670a7): created successfully Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f1e35e-350e-4a65-8d1f-fed2b594beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Flow 'volume_create_manager' (a646ebed-56db-459f-b83e-917ff49c12d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b9b2ac66-6b87-463a-b5b5-015ca5e82a49 tempest-VolumesListTestJSON-1830435146 None] Created volume successfully. Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201683a-67c2-4d14-88a3-0ac6542ed7d0]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:16 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:16 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:17 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 0 in 0.467s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:17 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:17 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:17 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 1 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 2G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f 2G" returned: 0 in 0.050s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.036s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-088b0865-fdcc-410f-9b27-b323b7acc513 tempest-VolumesExtendTest-2143436365 None] Extend volume completed successfully. Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Flow 'volume_create_manager' (fbd340f8-9cdd-40dc-8bab-bed62d29d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec84d10-8740-4b9f-a759-d1f49d73517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec84d10-8740-4b9f-a759-d1f49d73517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1455179382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05583e5-9bc6-4e66-832e-47b3fd78374a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='106128b28e0b49c084911d49bc440697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:18Z,use_quota=True,user_id='32626755a5974fdeaf97f64735cfbfda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca4d2f-1c6c-45d7-87df-778de4694df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca4d2f-1c6c-45d7-87df-778de4694df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e08194-63c7-4fea-8ee1-cd21952d7dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e08194-63c7-4fea-8ee1-cd21952d7dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05583e5-9bc6-4e66-832e-47b3fd78374a', 'volume_name': 'volume-a05583e5-9bc6-4e66-832e-47b3fd78374a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07f3114-af04-40cb-a0e0-78a8ed7ed15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07f3114-af04-40cb-a0e0-78a8ed7ed15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8116255-78d9-476c-892b-1efaab2c1fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:17 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Volume a05583e5-9bc6-4e66-832e-47b3fd78374a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05583e5-9bc6-4e66-832e-47b3fd78374a', 'volume_size': 1} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1455179382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05583e5-9bc6-4e66-832e-47b3fd78374a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='106128b28e0b49c084911d49bc440697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:18Z,use_quota=True,user_id='32626755a5974fdeaf97f64735cfbfda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Creating volume a05583e5-9bc6-4e66-832e-47b3fd78374a {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:17 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:17 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a 1073741824 Apr 17 16:26:17 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:18 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a 1073741824" returned: 0 in 0.485s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:18 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a Apr 17 16:26:18 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:18 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a" returned: 0 in 0.437s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8116255-78d9-476c-892b-1efaab2c1fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05583e5-9bc6-4e66-832e-47b3fd78374a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1892b9ff-c59d-485f-a7eb-9a3339d33e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:18 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Volume volume-a05583e5-9bc6-4e66-832e-47b3fd78374a (a05583e5-9bc6-4e66-832e-47b3fd78374a): created successfully Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1892b9ff-c59d-485f-a7eb-9a3339d33e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Flow 'volume_create_manager' (fbd340f8-9cdd-40dc-8bab-bed62d29d862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "cinder-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:18 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-76ab4cc6-39aa-4e3e-a29d-86fbea67270e tempest-VolumesListTestJSON-1830435146 None] Created volume successfully. Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "cinder-quobyte-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30bbdae-1194-46f3-8766-b3cf0ad528fb]: (4, 'raw') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:19 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:19 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:19 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 0 in 0.478s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:19 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:19 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:19 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 1 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f' failed. Not Retrying. {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 16:26:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:19 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f Apr 17 16:26:19 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Flow 'volume_create_manager' (243b6157-8585-49e8-afd1-fa7e61eed561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575a8d15-9bb4-4283-a85f-300dfcf4c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575a8d15-9bb4-4283-a85f-300dfcf4c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1124523731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e80882-80f6-4ac0-889f-169dc775d712,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='106128b28e0b49c084911d49bc440697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:20Z,use_quota=True,user_id='32626755a5974fdeaf97f64735cfbfda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234f5fb3-bc5d-4d44-b239-d582007f15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234f5fb3-bc5d-4d44-b239-d582007f15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78f8cb6-f173-41a6-916c-33af18e27238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78f8cb6-f173-41a6-916c-33af18e27238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e80882-80f6-4ac0-889f-169dc775d712', 'volume_name': 'volume-39e80882-80f6-4ac0-889f-169dc775d712', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b92ad99-0be8-469b-b4f9-80f53d728a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b92ad99-0be8-469b-b4f9-80f53d728a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0cb0e2-f025-4072-a47b-a6c32b745148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:20 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Volume 39e80882-80f6-4ac0-889f-169dc775d712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e80882-80f6-4ac0-889f-169dc775d712', 'volume_size': 1} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1124523731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e80882-80f6-4ac0-889f-169dc775d712,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='106128b28e0b49c084911d49bc440697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:20Z,use_quota=True,user_id='32626755a5974fdeaf97f64735cfbfda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Creating volume 39e80882-80f6-4ac0-889f-169dc775d712 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:20 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:20 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 1073741824 Apr 17 16:26:20 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:20 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" returned: 0 in 0.433s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f" released by "delete_volume" :: held 1.435s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Created reservations ['fcfca6b9-6bfd-4eeb-bc37-abf5478b7112', '3896b689-4e8a-4610-83c2-ab47ffa17bcd', 'b3ae48aa-6da9-4a51-96a7-4e731a2da4ca', 'c3b39fef-ffc9-43f2-adf6-1193eca374c9'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:20 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:20 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:20 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 1073741824" returned: 0 in 0.505s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:20 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 Apr 17 16:26:20 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:20 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.449s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:20 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Deleted volume successfully. Apr 17 16:26:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a2e39e5e-1cce-47e5-9a02-c3272be28d07 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-fd32ffab-dae9-46e8-82d4-4f0b05d6a33f-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:21 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712" returned: 0 in 0.423s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0cb0e2-f025-4072-a47b-a6c32b745148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e80882-80f6-4ac0-889f-169dc775d712', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdaabf8-76be-4ed9-b2b1-c629b6f6ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:21 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Volume volume-39e80882-80f6-4ac0-889f-169dc775d712 (39e80882-80f6-4ac0-889f-169dc775d712): created successfully Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdaabf8-76be-4ed9-b2b1-c629b6f6ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Flow 'volume_create_manager' (243b6157-8585-49e8-afd1-fa7e61eed561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:21 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6aa10866-4e6c-4c91-b4df-37e91d6d1c4c tempest-VolumesListTestJSON-1830435146 None] Created volume successfully. Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Flow 'volume_create_manager' (1bbe25c4-df25-43b2-baf6-53f6b3d36902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4da593-11d0-47a5-927d-ea028bb3fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4da593-11d0-47a5-927d-ea028bb3fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1549289931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f15a27-ae0e-4a8c-a832-8d47aa572217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95633fbd6c374ce19f8433d1ed765860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:21Z,use_quota=True,user_id='8e54c79965a2481dab8cd1a7492f02f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0263dc-12e0-4d58-bdc9-0dd2522914ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0263dc-12e0-4d58-bdc9-0dd2522914ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351a33f9-d706-4e3d-b792-6685729a9fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351a33f9-d706-4e3d-b792-6685729a9fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f15a27-ae0e-4a8c-a832-8d47aa572217', 'volume_name': 'volume-17f15a27-ae0e-4a8c-a832-8d47aa572217', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e8680f-5d20-4b50-bebd-286d3b5ef1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e8680f-5d20-4b50-bebd-286d3b5ef1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648ad2e6-dea6-4ff9-9dca-17d4d82f0e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:21 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Volume 17f15a27-ae0e-4a8c-a832-8d47aa572217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f15a27-ae0e-4a8c-a832-8d47aa572217', 'volume_size': 1} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1549289931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f15a27-ae0e-4a8c-a832-8d47aa572217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95633fbd6c374ce19f8433d1ed765860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:21Z,use_quota=True,user_id='8e54c79965a2481dab8cd1a7492f02f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Creating volume 17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:21 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:21 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 1073741824 Apr 17 16:26:21 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:21 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 1073741824" returned: 0 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:21 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 Apr 17 16:26:21 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:22 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648ad2e6-dea6-4ff9-9dca-17d4d82f0e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f15a27-ae0e-4a8c-a832-8d47aa572217', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb82351-56da-429d-a459-20cf3f92455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:22 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Volume volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 (17f15a27-ae0e-4a8c-a832-8d47aa572217): created successfully Apr 17 16:26:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb82351-56da-429d-a459-20cf3f92455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:22 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Flow 'volume_create_manager' (1bbe25c4-df25-43b2-baf6-53f6b3d36902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:22 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6770971d-f6ba-4d7c-9ac2-48eed7543112 tempest-VolumesExtendTest-2143436365 None] Created volume successfully. Apr 17 16:26:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:23 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Creating offline snapshot 2b6feab5-5e1f-48f9-b180-bd278f628e46 of volume 17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:26:23 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07b1dba-b75b-4df0-be4d-b377487f1ce8]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:24 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 Apr 17 16:26:24 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "cinder-39e80882-80f6-4ac0-889f-169dc775d712-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-39e80882-80f6-4ac0-889f-169dc775d712-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "cinder-quobyte-39e80882-80f6-4ac0-889f-169dc775d712" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-quobyte-39e80882-80f6-4ac0-889f-169dc775d712" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da8857-7f09-4eeb-85d8-7799e773e17b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:24 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 Apr 17 16:26:24 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:24 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217" returned: 0 in 0.533s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:24 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 1G Apr 17 16:26:24 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:24 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:24 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712 Apr 17 16:26:24 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:24 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 1G" returned: 0 in 0.495s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:24 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 Apr 17 16:26:24 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:25 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-39e80882-80f6-4ac0-889f-169dc775d712" returned: 0 in 0.458s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-quobyte-39e80882-80f6-4ac0-889f-169dc775d712" released by "delete_volume" :: held 1.013s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Created reservations ['f65c7805-8454-4346-8733-ad918bb9e3dd', '5e1e5990-1fd9-4351-b15a-e8943fdd5b63', 'b9418982-d400-4c26-80cd-9dcbe8fbe521', '85d9adeb-512e-41ec-9186-bbc576014d1b'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:25 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:25 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:25 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46" returned: 0 in 0.462s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:25 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 is being set with open permissions: ugo+rw Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:25 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 Apr 17 16:26:25 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:25 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.437s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Deleted volume successfully. Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-78ff841f-741e-47e3-9eb3-e380fba13ee2 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-39e80882-80f6-4ac0-889f-169dc775d712-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:25 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46" returned: 0 in 0.430s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:25 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.info Apr 17 16:26:25 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:26 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.info" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:26 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.info is being set with open permissions: ugo+rw Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:26 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.info Apr 17 16:26:26 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "cinder-a05583e5-9bc6-4e66-832e-47b3fd78374a-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-a05583e5-9bc6-4e66-832e-47b3fd78374a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "cinder-quobyte-a05583e5-9bc6-4e66-832e-47b3fd78374a" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-quobyte-a05583e5-9bc6-4e66-832e-47b3fd78374a" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f4a67-149f-4680-a4ae-0695555d1a69]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:26 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a Apr 17 16:26:26 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:26 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.info" returned: 0 in 0.418s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.855s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:26 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ddf4ee5e-2a32-4b6c-adbc-a19d021692f5 tempest-VolumesExtendTest-2143436365 None] Create snapshot completed successfully Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd095965-3517-4bf0-b909-d97671079ee1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:27 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a" returned: 0 in 0.526s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:27 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 Apr 17 16:26:27 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:27 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a Apr 17 16:26:27 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:27 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 2G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:27 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-a05583e5-9bc6-4e66-832e-47b3fd78374a" returned: 0 in 0.448s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-quobyte-a05583e5-9bc6-4e66-832e-47b3fd78374a" released by "delete_volume" :: held 1.009s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Created reservations ['3a886d65-e2ce-4f45-8c1c-fdae0c75562e', 'c3ed7b22-df15-4fe5-a3d1-ff6b138f27e5', '4afc6ba6-b952-4078-9b03-bf05556e9a94', '4c16c39a-b0f9-491b-90ea-a5ca38b70f97'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 2G" returned: 0 in 0.073s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.576s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:27 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7495bf80-f38b-4024-ace0-1eb4035c6812 tempest-VolumesExtendTest-2143436365 None] Extend volume completed successfully. Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:27 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:27 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:28 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.437s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:28 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Deleted volume successfully. Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-de7aebe1-132e-4ee1-82f1-692b76528019 tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-a05583e5-9bc6-4e66-832e-47b3fd78374a-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "cinder-2b6feab5-5e1f-48f9-b180-bd278f628e46-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-2b6feab5-5e1f-48f9-b180-bd278f628e46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "cinder-quobyte-17f15a27-ae0e-4a8c-a832-8d47aa572217" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-17f15a27-ae0e-4a8c-a832-8d47aa572217" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "cinder-quobyte-2b6feab5-5e1f-48f9-b180-bd278f628e46" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-2b6feab5-5e1f-48f9-b180-bd278f628e46" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Deleting offline snapshot 2b6feab5-5e1f-48f9-b180-bd278f628e46 of volume 17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] snapshot_file for this snap is: volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed37cf4-7632-4724-9362-d8375372ee23]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:28 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 Apr 17 16:26:28 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "cinder-dfd5ae78-0505-4edc-84b3-d3f1390670a7-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-dfd5ae78-0505-4edc-84b3-d3f1390670a7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "cinder-quobyte-dfd5ae78-0505-4edc-84b3-d3f1390670a7" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-quobyte-dfd5ae78-0505-4edc-84b3-d3f1390670a7" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:28 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46" returned: 0 in 0.502s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17f15a27-ae0e-4a8c-a832-8d47aa572217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf945ac-a677-4fec-9a49-7dbba4ecdc45]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c190a3e-8729-441e-b91a-e24805c00405]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:28 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 Apr 17 16:26:28 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:28 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 Apr 17 16:26:28 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:29 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7" returned: 0 in 0.475s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:29 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217" returned: 0 in 0.474s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:29 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7 Apr 17 16:26:29 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:29 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 Apr 17 16:26:29 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:29 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-dfd5ae78-0505-4edc-84b3-d3f1390670a7" returned: 0 in 0.440s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-quobyte-dfd5ae78-0505-4edc-84b3-d3f1390670a7" released by "delete_volume" :: held 0.953s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Created reservations ['2efda361-711d-42fd-8404-414217e83700', '67ebf853-07d6-43c4-8198-abc016cecc0f', 'd537c9c6-b8a0-4645-9a3f-ab9c8a5a00ad', 'fd7eab8b-d108-48e4-a601-d8a96cdb0783'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:29 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46" returned: 0 in 0.478s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:29 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46 Apr 17 16:26:29 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:29 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:29 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:30 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217.2b6feab5-5e1f-48f9-b180-bd278f628e46" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-2b6feab5-5e1f-48f9-b180-bd278f628e46" released by "_delete_snapshot" :: held 1.963s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-17f15a27-ae0e-4a8c-a832-8d47aa572217" released by "delete_snapshot" :: held 1.973s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Created reservations ['08b36dfd-2025-49e4-bb2a-abc187c9cf7a', '854f5870-26ba-443d-9bf0-ff93ea61787b', '3e80b86e-81a3-4c3e-8a6d-de07550da882', '06f65a6c-dbf8-45ba-918b-ebe7d64339e0'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:30 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.515s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:30 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Deleted volume successfully. Apr 17 16:26:30 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Delete snapshot completed successfully. Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-9c49b065-bc9e-4d09-9a07-805cd7fc4c1c tempest-VolumesListTestJSON-1830435146 None] Lock "cinder-dfd5ae78-0505-4edc-84b3-d3f1390670a7-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-57ac5e21-608b-4f66-a1d5-c97635be7db1 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-2b6feab5-5e1f-48f9-b180-bd278f628e46-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "cinder-17f15a27-ae0e-4a8c-a832-8d47aa572217-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-17f15a27-ae0e-4a8c-a832-8d47aa572217-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "cinder-quobyte-17f15a27-ae0e-4a8c-a832-8d47aa572217" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-17f15a27-ae0e-4a8c-a832-8d47aa572217" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5a62f2-c5ff-4b41-abb0-6b8d2ef291bd]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:31 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 Apr 17 16:26:31 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Flow 'volume_create_manager' (8f042326-8aca-499c-8352-695c694867da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab66cc1a-daac-4327-b2b0-48d9b000298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab66cc1a-daac-4327-b2b0-48d9b000298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2144457088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c572964f044a778b6e36480ad32d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:32Z,use_quota=True,user_id='cc0ffc246a13484eb4d91b26f151283d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acb6e9c-d5b0-46d8-baa3-0cd3fdb46b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acb6e9c-d5b0-46d8-baa3-0cd3fdb46b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e31dea-dcc2-47d6-97b3-3319273597a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e31dea-dcc2-47d6-97b3-3319273597a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d', 'volume_name': 'volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d', 'volume_size': 2}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ef6cb4-2b58-4c8f-bae0-6d3e8e2aa76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ef6cb4-2b58-4c8f-bae0-6d3e8e2aa76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e86c0dc-5b25-436c-b740-ed1cf692f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:31 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Volume 408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d', 'volume_size': 2} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2144457088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c572964f044a778b6e36480ad32d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:32Z,use_quota=True,user_id='cc0ffc246a13484eb4d91b26f151283d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Creating volume 408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:31 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d 2147483648 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:31 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d 2147483648 Apr 17 16:26:31 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:32 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217" returned: 0 in 0.511s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:32 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217 Apr 17 16:26:32 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:32 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d 2147483648" returned: 0 in 0.496s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:32 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d Apr 17 16:26:32 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:32 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-17f15a27-ae0e-4a8c-a832-8d47aa572217" returned: 0 in 0.437s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-quobyte-17f15a27-ae0e-4a8c-a832-8d47aa572217" released by "delete_volume" :: held 0.993s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Created reservations ['a4d64919-dff1-48f4-9bd2-53755915b2ad', 'f2039c14-9b23-4d4d-a257-7c31facc19f7', 'c76a74cb-47cc-4361-b321-e73611e001fe', '198f0691-a1b9-4781-9383-7700669ab747'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:32 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:32 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:32 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" returned: 0 in 0.465s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e86c0dc-5b25-436c-b740-ed1cf692f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d', 'volume_size': 2}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91a5fb0-faa1-49fd-9b13-8a622d3ce7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:32 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Volume volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d (408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d): created successfully Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91a5fb0-faa1-49fd-9b13-8a622d3ce7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Flow 'volume_create_manager' (8f042326-8aca-499c-8352-695c694867da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:32 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-18a127be-e3f2-4419-8cd9-bd02ebbba439 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Created volume successfully. Apr 17 16:26:33 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.423s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:33 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Deleted volume successfully. Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-436dbae7-7b21-442a-855f-4ff4e7557368 tempest-VolumesExtendTest-2143436365 None] Lock "cinder-17f15a27-ae0e-4a8c-a832-8d47aa572217-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:33 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:33 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Creating offline snapshot fe54c401-46b1-437f-81d0-ee247a7c97b7 of volume 408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d31d50-4332-4380-958e-23fee8df7300]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:34 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d Apr 17 16:26:34 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:34 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.448s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:34 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 2G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:34 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 2G Apr 17 16:26:34 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:35 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 2G" returned: 0 in 0.541s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:35 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 Apr 17 16:26:35 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:35 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:35 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 is being set with open permissions: ugo+rw Apr 17 16:26:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:35 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 Apr 17 16:26:35 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:36 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:36 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.info Apr 17 16:26:36 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:36 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.info" returned: 0 in 0.457s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:36 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.info is being set with open permissions: ugo+rw Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:36 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.info Apr 17 16:26:36 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (7d035eae-3131-4ee6-93cf-87d29afe1961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df98f5e-6f99-4771-af0c-808a5de87aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df98f5e-6f99-4771-af0c-808a5de87aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-457971647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb3e87a-12e1-4d8d-908d-dc63722d2e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffff349c68934803a590d81a48a2231d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:37Z,use_quota=True,user_id='3ef86b4178d54c7d8dc0aff3387539d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b7d2fb-7667-47d1-9dfa-36f35bef1842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b7d2fb-7667-47d1-9dfa-36f35bef1842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283eab1-e643-4444-b1f6-0398137122d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283eab1-e643-4444-b1f6-0398137122d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb3e87a-12e1-4d8d-908d-dc63722d2e20', 'volume_name': 'volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0aec7b-b3fd-4fa7-9948-ba4eb194ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0aec7b-b3fd-4fa7-9948-ba4eb194ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acef684-96b0-4d22-b002-09ec9cd73a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Volume afb3e87a-12e1-4d8d-908d-dc63722d2e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20', 'volume_size': 1} Apr 17 16:26:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:37 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.info" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-457971647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb3e87a-12e1-4d8d-908d-dc63722d2e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffff349c68934803a590d81a48a2231d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:37Z,use_quota=True,user_id='3ef86b4178d54c7d8dc0aff3387539d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Creating volume afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:37 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:37 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 1073741824 Apr 17 16:26:37 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d9438442-d5f5-4056-8b46-4bb1895397eb tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Create snapshot completed successfully Apr 17 16:26:37 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 1073741824" returned: 0 in 0.504s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:37 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 Apr 17 16:26:37 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:37 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20" returned: 0 in 0.412s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acef684-96b0-4d22-b002-09ec9cd73a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565fcb78-c87a-41e8-aec8-39cd45a24d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Volume volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 (afb3e87a-12e1-4d8d-908d-dc63722d2e20): created successfully Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565fcb78-c87a-41e8-aec8-39cd45a24d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (7d035eae-3131-4ee6-93cf-87d29afe1961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:38 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0dc9728d-c690-4624-b520-665eae9a88ed tempest-VolumeDependencyTests-31297999 None] Created volume successfully. Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "cinder-fe54c401-46b1-437f-81d0-ee247a7c97b7-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-fe54c401-46b1-437f-81d0-ee247a7c97b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "cinder-quobyte-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-quobyte-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "cinder-quobyte-fe54c401-46b1-437f-81d0-ee247a7c97b7" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-quobyte-fe54c401-46b1-437f-81d0-ee247a7c97b7" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Deleting offline snapshot fe54c401-46b1-437f-81d0-ee247a7c97b7 of volume 408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] snapshot_file for this snap is: volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a86687-373f-4494-8505-d5ab04db81ba]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:38 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 Apr 17 16:26:38 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:38 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dc8bf1-80cf-4bbb-911c-c3d49e965936]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:38 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d Apr 17 16:26:38 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Creating offline snapshot a3ff991f-3b2a-4a81-9102-adbc623ac6e0 of volume afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24e9462-df62-4f8b-8f4b-aa6204918d61]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:39 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" returned: 0 in 0.505s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:39 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 Apr 17 16:26:39 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 Apr 17 16:26:39 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:39 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:39 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:39 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7" returned: 0 in 0.460s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:39 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 1G Apr 17 16:26:39 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:39 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7 Apr 17 16:26:39 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:40 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d.fe54c401-46b1-437f-81d0-ee247a7c97b7" returned: 0 in 0.422s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-quobyte-fe54c401-46b1-437f-81d0-ee247a7c97b7" released by "_delete_snapshot" :: held 1.917s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-quobyte-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" released by "delete_snapshot" :: held 1.928s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:40 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 1G" returned: 0 in 0.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:40 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 Apr 17 16:26:40 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Created reservations ['b6ca6005-2ceb-4716-8fc8-3782f0c872a9', 'a30a7cf5-0bd9-4d11-92e0-63d14412fd29', '81401d4a-bd8a-4346-8b79-2e72b0917335', '31a1f3fc-6165-4768-a1ed-cf075c99a6ab'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:40 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Delete snapshot completed successfully. Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-77ac014a-2fc5-494d-bfd9-e093abf5cf67 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-fe54c401-46b1-437f-81d0-ee247a7c97b7-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "cinder-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "cinder-quobyte-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-quobyte-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" acquired by "delete_volume" :: waited 0.022s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9d81a4-65a4-453b-9fba-ed37c1e54f15]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:40 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d Apr 17 16:26:40 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:40 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0" returned: 0 in 0.490s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:40 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 is being set with open permissions: ugo+rw Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:40 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 Apr 17 16:26:40 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:40 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:40 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d Apr 17 16:26:40 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:41 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0" returned: 0 in 0.410s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:41 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.info Apr 17 16:26:41 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:41 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" returned: 0 in 0.419s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-quobyte-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d" released by "delete_volume" :: held 0.925s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Created reservations ['ba03f03e-b0a9-492d-89b9-9ee25c224104', '164ab035-e426-480e-8496-0b8cc6a59c6b', '7da9b81b-b6e1-46e8-a623-2e78b8f5f652', '7af393f1-76ce-4b1a-94c8-b55ffe8a08e7'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:41 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:41 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:41 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.info" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:41 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.info is being set with open permissions: ugo+rw Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:41 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.info Apr 17 16:26:41 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:41 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Deleted volume successfully. Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d3ffd3ce-2376-49f8-95cb-311a4b8b4237 tempest-VolumesSnapshotNegativeTestJSON-1278006321 None] Lock "cinder-408d1ff1-e7ab-4fd3-9f79-3e0751bd7d5d-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:41 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.info" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-72ff7487-902c-402b-876a-2d8537e37859 tempest-VolumeDependencyTests-31297999 None] Create snapshot completed successfully Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (7105b890-53a5-4b17-890e-da618e2ede88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e30a5e3-770f-48bb-ad67-24047d06591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e30a5e3-770f-48bb-ad67-24047d06591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422026445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219cd8c5-0c0a-4fa0-832e-e7499c8236e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffff349c68934803a590d81a48a2231d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3ff991f-3b2a-4a81-9102-adbc623ac6e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:43Z,use_quota=True,user_id='3ef86b4178d54c7d8dc0aff3387539d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b1eff4-3582-4180-9b66-25f9175d2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b1eff4-3582-4180-9b66-25f9175d2161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389bf960-9a47-4ec4-8384-66bd705395c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389bf960-9a47-4ec4-8384-66bd705395c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '219cd8c5-0c0a-4fa0-832e-e7499c8236e9', 'volume_name': 'volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9', 'volume_size': 1, 'snapshot_id': 'a3ff991f-3b2a-4a81-9102-adbc623ac6e0'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4755ffa1-2ec6-41a2-bd04-cd4f241526ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4755ffa1-2ec6-41a2-bd04-cd4f241526ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38850443-6af6-4c8e-9502-9dbe86ef49c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:42 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Volume 219cd8c5-0c0a-4fa0-832e-e7499c8236e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9', 'volume_size': 1, 'snapshot_id': 'a3ff991f-3b2a-4a81-9102-adbc623ac6e0'} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-a3ff991f-3b2a-4a81-9102-adbc623ac6e0-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-a3ff991f-3b2a-4a81-9102-adbc623ac6e0-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Creating volume 219cd8c5-0c0a-4fa0-832e-e7499c8236e9 from snapshot a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] snapshot: a3ff991f-3b2a-4a81-9102-adbc623ac6e0, volume: 219cd8c5-0c0a-4fa0-832e-e7499c8236e9, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fe3731-9aa3-49e6-9cf8-e44b35de55f6]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:42 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 Apr 17 16:26:42 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:43 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0" returned: 0 in 0.524s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e750fe8e-18a8-4d8b-8cd3-e3efb527025e]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:43 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 Apr 17 16:26:43 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:43 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20" returned: 0 in 0.517s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:26:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:43 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 Apr 17 16:26:43 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:45 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" returned: 0 in 2.164s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:45 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00a188-acfc-4197-a3f8-fbf60766f6fc]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:45 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 Apr 17 16:26:45 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:46 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20" returned: 0 in 0.640s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:26:46 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Converted 1024.00 MB image at 472.83 MB/s Apr 17 16:26:46 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 is being set with open permissions: ugo+rw Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:46 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 Apr 17 16:26:46 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:46 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" returned: 0 in 0.431s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" released by "_copy_volume_from_snapshot" :: held 4.338s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-a3ff991f-3b2a-4a81-9102-adbc623ac6e0-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" released by "_create_volume_from_snapshot" :: held 4.353s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.361s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38850443-6af6-4c8e-9502-9dbe86ef49c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9', 'volume_size': 1, 'snapshot_id': 'a3ff991f-3b2a-4a81-9102-adbc623ac6e0'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70b47cc-13b9-447f-95e3-2dc6a93c45c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:47 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Volume volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 (219cd8c5-0c0a-4fa0-832e-e7499c8236e9): created successfully Apr 17 16:26:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70b47cc-13b9-447f-95e3-2dc6a93c45c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (7105b890-53a5-4b17-890e-da618e2ede88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:47 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a3149847-601b-4e5a-93f1-4e14498bd13f tempest-VolumeDependencyTests-31297999 None] Created volume successfully. Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-a3ff991f-3b2a-4a81-9102-adbc623ac6e0-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Lock "cinder-a3ff991f-3b2a-4a81-9102-adbc623ac6e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-afb3e87a-12e1-4d8d-908d-dc63722d2e20" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-afb3e87a-12e1-4d8d-908d-dc63722d2e20" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-a3ff991f-3b2a-4a81-9102-adbc623ac6e0" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-a3ff991f-3b2a-4a81-9102-adbc623ac6e0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Deleting offline snapshot a3ff991f-3b2a-4a81-9102-adbc623ac6e0 of volume afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] snapshot_file for this snap is: volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad77cc5-83f4-4ecd-a1c8-f5628ced51b3]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:48 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 Apr 17 16:26:48 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:48 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[af21d83e-2465-4036-abd9-f4c27a92bcf1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:48 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 Apr 17 16:26:48 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:49 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20" returned: 0 in 0.537s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:49 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 Apr 17 16:26:49 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:49 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:49 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0 Apr 17 16:26:49 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:50 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20.a3ff991f-3b2a-4a81-9102-adbc623ac6e0" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-a3ff991f-3b2a-4a81-9102-adbc623ac6e0" released by "_delete_snapshot" :: held 2.148s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-afb3e87a-12e1-4d8d-908d-dc63722d2e20" released by "delete_snapshot" :: held 2.160s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:50 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Created reservations ['891a3d35-631e-49c1-9626-37e07a487c6f', '216e19ca-e072-46f0-910e-adb0cc33524f', '4ae7ed0d-dc46-4f31-8c05-785999312b7f', '236da359-27ba-4916-a8e7-8d1c1d4e32f7'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:50 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Delete snapshot completed successfully. Apr 17 16:26:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-7b4747ce-cbec-4438-849b-330ed55c7ced tempest-VolumeDependencyTests-31297999 None] Lock "cinder-a3ff991f-3b2a-4a81-9102-adbc623ac6e0-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-afb3e87a-12e1-4d8d-908d-dc63722d2e20-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-afb3e87a-12e1-4d8d-908d-dc63722d2e20-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-afb3e87a-12e1-4d8d-908d-dc63722d2e20" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-afb3e87a-12e1-4d8d-908d-dc63722d2e20" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[532cd480-e841-4431-8313-9e31fef7ed99]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:51 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 Apr 17 16:26:51 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:51 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20" returned: 0 in 0.529s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:51 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20 Apr 17 16:26:51 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:52 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-afb3e87a-12e1-4d8d-908d-dc63722d2e20" returned: 0 in 0.433s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-afb3e87a-12e1-4d8d-908d-dc63722d2e20" released by "delete_volume" :: held 1.002s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Created reservations ['cffa65b3-e56e-45d3-9055-278b48b17540', 'f4ff0bdb-47ed-435b-b31a-bff9ee9fad5d', 'af5faf26-97f4-4060-bc91-41d5a66ce1f6', '0a839bbb-d400-4a01-b83b-2a84803d8107'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:52 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:26:52 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:52 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:26:52 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Deleted volume successfully. Apr 17 16:26:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d58faf09-c213-4b59-9815-d86d8ce15ad3 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-afb3e87a-12e1-4d8d-908d-dc63722d2e20-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (8a5e4c52-b34b-4aef-a4b0-3a78f5212662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8a1e7a-e05f-48b1-a3e0-83fa6e270804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8a1e7a-e05f-48b1-a3e0-83fa6e270804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-522982841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94933e7b-508d-4530-a7f5-fd5032278351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffff349c68934803a590d81a48a2231d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:54Z,use_quota=True,user_id='3ef86b4178d54c7d8dc0aff3387539d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202c8d0b-38ad-4255-9c19-36b1c894c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202c8d0b-38ad-4255-9c19-36b1c894c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b805a7f4-a2df-499b-a925-21701dfa9b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b805a7f4-a2df-499b-a925-21701dfa9b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94933e7b-508d-4530-a7f5-fd5032278351', 'volume_name': 'volume-94933e7b-508d-4530-a7f5-fd5032278351', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b25189-90aa-441f-9af9-dcaccc4882f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b25189-90aa-441f-9af9-dcaccc4882f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52642a7-6e6b-4a13-9a01-6c5604d87389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:53 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Volume 94933e7b-508d-4530-a7f5-fd5032278351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94933e7b-508d-4530-a7f5-fd5032278351', 'volume_size': 1} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-522982841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94933e7b-508d-4530-a7f5-fd5032278351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffff349c68934803a590d81a48a2231d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:54Z,use_quota=True,user_id='3ef86b4178d54c7d8dc0aff3387539d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Creating volume 94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:26:53 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:26:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:53 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 1073741824 Apr 17 16:26:53 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:54 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 1073741824" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:54 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 Apr 17 16:26:54 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:54 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351" returned: 0 in 0.467s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52642a7-6e6b-4a13-9a01-6c5604d87389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94933e7b-508d-4530-a7f5-fd5032278351', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec73ebb-711f-4293-bf95-d51393ce166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Volume volume-94933e7b-508d-4530-a7f5-fd5032278351 (94933e7b-508d-4530-a7f5-fd5032278351): created successfully Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec73ebb-711f-4293-bf95-d51393ce166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (8a5e4c52-b34b-4aef-a4b0-3a78f5212662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:54 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-41bb6916-3e6d-46b1-be53-c0b5041c69f0 tempest-VolumeDependencyTests-31297999 None] Created volume successfully. Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (ec329d89-96f8-4f4f-ba49-b2e3a6e46b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8edee43-e1d5-44cc-974c-b95b7a3749dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8edee43-e1d5-44cc-974c-b95b7a3749dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1982063478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c1bfe7-dacc-4f58-a9c6-ab95f916ca90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffff349c68934803a590d81a48a2231d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=94933e7b-508d-4530-a7f5-fd5032278351,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:56Z,use_quota=True,user_id='3ef86b4178d54c7d8dc0aff3387539d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653c53ae-86f5-44d3-9577-ee79ca97dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653c53ae-86f5-44d3-9577-ee79ca97dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c532ff8-7495-466e-9f2c-fb1aa61a1931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c532ff8-7495-466e-9f2c-fb1aa61a1931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '76c1bfe7-dacc-4f58-a9c6-ab95f916ca90', 'volume_name': 'volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90', 'volume_size': 1, 'source_volid': '94933e7b-508d-4530-a7f5-fd5032278351', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eb3ef2-bc0b-46fd-acfb-dbdd4e47da7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eb3ef2-bc0b-46fd-acfb-dbdd4e47da7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283e5493-3dc3-421a-8f66-21365cbf03c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:56 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Volume 76c1bfe7-dacc-4f58-a9c6-ab95f916ca90: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90', 'volume_size': 1, 'source_volid': '94933e7b-508d-4530-a7f5-fd5032278351', 'source_volstatus': 'available'} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:56 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Cloning volume 94933e7b-508d-4530-a7f5-fd5032278351 to volume 76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Creating offline snapshot ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 of volume 94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb3b5f-ee58-4502-887a-fa71121a9603]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:56 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 Apr 17 16:26:56 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:56 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351" returned: 0 in 0.630s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:56 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 1G Apr 17 16:26:56 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Flow 'volume_create_manager' (55cf3582-8be7-433f-bbe3-467c4c1b07ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125ca271-331e-44b5-80e4-680bfdaf83ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125ca271-331e-44b5-80e4-680bfdaf83ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-493200472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29707f28-73d1-43e2-acfb-0cf0086e1640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e112fd00e61741acbb351cf43f595571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:57Z,use_quota=True,user_id='42fc4a12853749b0ae3b779dbfab0c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca1ebea-a50c-468b-8ec8-eac33f6134dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca1ebea-a50c-468b-8ec8-eac33f6134dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6dbc88-661c-4de0-a1a6-b026b4c5b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6dbc88-661c-4de0-a1a6-b026b4c5b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29707f28-73d1-43e2-acfb-0cf0086e1640', 'volume_name': 'volume-29707f28-73d1-43e2-acfb-0cf0086e1640', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd5077f-8cb3-4398-9849-d9a8af8aa1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd5077f-8cb3-4398-9849-d9a8af8aa1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac67f17b-9e51-4387-8819-22a7bcc8e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:26:57 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Volume 29707f28-73d1-43e2-acfb-0cf0086e1640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29707f28-73d1-43e2-acfb-0cf0086e1640', 'volume_size': 1} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:57 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 1G" returned: 0 in 0.577s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94933e7b-508d-4530-a7f5-fd5032278351 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:57 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94933e7b-508d-4530-a7f5-fd5032278351 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 Apr 17 16:26:57 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:57 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94933e7b-508d-4530-a7f5-fd5032278351 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" returned: 0 in 0.452s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:57 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 is being set with open permissions: ugo+rw Apr 17 16:26:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:57 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 Apr 17 16:26:57 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:58 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" returned: 0 in 0.432s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:58 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.info Apr 17 16:26:58 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:58 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.info" returned: 0 in 0.413s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:58 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.info is being set with open permissions: ugo+rw Apr 17 16:26:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:58 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.info Apr 17 16:26:58 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:59 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.info" returned: 0 in 0.416s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] snapshot: ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586, volume: 76c1bfe7-dacc-4f58-a9c6-ab95f916ca90, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e5801c-08bb-45ad-922b-b0ca8bf95187]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:59 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 Apr 17 16:26:59 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:26:59 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94933e7b-508d-4530-a7f5-fd5032278351(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb49a962-6205-4125-a1f6-8bf70e49815d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:26:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:26:59 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 Apr 17 16:26:59 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:00 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351" returned: 0 in 0.463s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:00 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:27:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:00 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 Apr 17 16:27:00 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:02 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" returned: 0 in 1.986s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:02 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[274fd683-8973-4814-9fc5-9ed5430645a9]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:02 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 Apr 17 16:27:02 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:02 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351" returned: 0 in 0.651s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:02 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:27:02 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Converted 1024.00 MB image at 515.04 MB/s Apr 17 16:27:02 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 is being set with open permissions: ugo+rw Apr 17 16:27:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:02 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 Apr 17 16:27:02 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:03 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" released by "_copy_volume_from_snapshot" :: held 4.053s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=115,cinder:UPDATE=146,cinder:INSERT=42,cinder:DELETE=15 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Deleting offline snapshot ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 of volume 94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] snapshot_file for this snap is: volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4eb8f-a689-4ba7-914c-ac351df8ac9f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:03 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 Apr 17 16:27:03 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:03 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" returned: 0 in 0.511s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94933e7b-508d-4530-a7f5-fd5032278351(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8395285d-9867-4fbf-8190-a6d3c77ed4c1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:03 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 Apr 17 16:27:03 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:04 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351" returned: 0 in 0.475s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:04 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 Apr 17 16:27:04 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:04 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" returned: 0 in 0.469s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:04 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586 Apr 17 16:27:04 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:05 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351.ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-ba01f8ed-b9d4-48b9-b9f3-1b8816cf7586" released by "_delete_snapshot" :: held 1.924s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:UPDATE=158,cinder:SELECT=126,cinder:INSERT=43,cinder:DELETE=11 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.019s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.820s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-493200472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29707f28-73d1-43e2-acfb-0cf0086e1640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e112fd00e61741acbb351cf43f595571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:26:57Z,use_quota=True,user_id='42fc4a12853749b0ae3b779dbfab0c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Creating volume 29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:05 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:05 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 1073741824 Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283e5493-3dc3-421a-8f66-21365cbf03c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90', 'volume_size': 1, 'source_volid': '94933e7b-508d-4530-a7f5-fd5032278351', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:05 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51390e12-a522-461f-8127-1322f40ba324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:05 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Volume volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 (76c1bfe7-dacc-4f58-a9c6-ab95f916ca90): created successfully Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51390e12-a522-461f-8127-1322f40ba324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Flow 'volume_create_manager' (ec329d89-96f8-4f4f-ba49-b2e3a6e46b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:05 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fde31a6e-a543-4b74-bb57-a11414214b49 tempest-VolumeDependencyTests-31297999 None] Created volume successfully. Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-94933e7b-508d-4530-a7f5-fd5032278351-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-94933e7b-508d-4530-a7f5-fd5032278351-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-94933e7b-508d-4530-a7f5-fd5032278351" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-94933e7b-508d-4530-a7f5-fd5032278351" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccbdef9-02b5-406a-8e07-92e6dfdc801d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:05 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 1073741824" returned: 0 in 0.530s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:05 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:05 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 Apr 17 16:27:05 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:05 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 Apr 17 16:27:05 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:06 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640" returned: 0 in 0.428s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac67f17b-9e51-4387-8819-22a7bcc8e340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29707f28-73d1-43e2-acfb-0cf0086e1640', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3584ebdf-ccb1-4b73-9fa3-feb58fe3eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:06 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Volume volume-29707f28-73d1-43e2-acfb-0cf0086e1640 (29707f28-73d1-43e2-acfb-0cf0086e1640): created successfully Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3584ebdf-ccb1-4b73-9fa3-feb58fe3eef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Flow 'volume_create_manager' (55cf3582-8be7-433f-bbe3-467c4c1b07ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:06 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-369e3be7-f162-4ecd-92b3-b4ae8c1ba44f tempest-SnapshotDependencyTests-640087740 None] Created volume successfully. Apr 17 16:27:06 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351" returned: 0 in 0.521s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:06 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351 Apr 17 16:27:06 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:06 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-94933e7b-508d-4530-a7f5-fd5032278351" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-94933e7b-508d-4530-a7f5-fd5032278351" released by "delete_volume" :: held 0.987s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Created reservations ['d011776e-c7da-4060-bb6b-ea7a5e623e82', 'fb4eb951-a1f3-4572-9ea9-853dc4c5b82f', '1ae6c619-8ddf-4550-bba8-d4447cb13d01', 'bf52ff92-4c95-4afc-b801-1e2bb1abc3e0'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:06 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:06 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Lock "cinder-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[92769c64-28f8-47ad-87d5-25be6022eeab]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:06 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 Apr 17 16:27:06 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Creating offline snapshot b8943410-5e9d-4ee3-9408-9afd5bfe360e of volume 29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[29716387-d11c-4dde-b9b4-616422d73e66]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:07 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 Apr 17 16:27:07 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:07 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:07 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Deleted volume successfully. Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2a6ffe12-2602-4201-a1c5-f65b8413dea8 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-94933e7b-508d-4530-a7f5-fd5032278351-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:07 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:07 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90 Apr 17 16:27:07 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:07 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640" returned: 0 in 0.508s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:07 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e 1G Apr 17 16:27:07 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:07 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" returned: 0 in 0.488s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90" released by "delete_volume" :: held 1.089s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:07 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Created reservations ['1462779a-31ad-409f-a005-24ccb343b0a3', '94a68632-fe4b-42df-84e9-dac5dfaeca04', '73de40c9-97df-4f9b-8389-96553e9b62b9', 'af374199-5a77-471d-8abf-46cd07fcb7f2'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:08 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:08 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:08 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e 1G" returned: 0 in 0.503s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29707f28-73d1-43e2-acfb-0cf0086e1640 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:08 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29707f28-73d1-43e2-acfb-0cf0086e1640 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e Apr 17 16:27:08 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:08 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.454s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:08 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Deleted volume successfully. Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-97969009-5a23-41a5-b834-cd7eb64a4c8d tempest-VolumeDependencyTests-31297999 None] Lock "cinder-76c1bfe7-dacc-4f58-a9c6-ab95f916ca90-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:08 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29707f28-73d1-43e2-acfb-0cf0086e1640 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e" returned: 0 in 0.450s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:08 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e is being set with open permissions: ugo+rw Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:08 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e Apr 17 16:27:08 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:08 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e" returned: 0 in 0.446s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-219cd8c5-0c0a-4fa0-832e-e7499c8236e9-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-219cd8c5-0c0a-4fa0-832e-e7499c8236e9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:09 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.info Apr 17 16:27:09 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "cinder-quobyte-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b466c-a3fd-4164-8a87-1e7b1da3f296]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:09 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 Apr 17 16:27:09 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:09 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.info" returned: 0 in 0.435s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:09 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.info is being set with open permissions: ugo+rw Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:09 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.info Apr 17 16:27:09 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:09 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" returned: 0 in 0.512s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:09 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9 Apr 17 16:27:09 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:09 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.info" returned: 0 in 0.418s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:09 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a43a45bf-d14d-4da0-8346-6e8a709a2f57 tempest-SnapshotDependencyTests-640087740 None] Create snapshot completed successfully Apr 17 16:27:10 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-quobyte-219cd8c5-0c0a-4fa0-832e-e7499c8236e9" released by "delete_volume" :: held 0.957s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Created reservations ['21f19622-63d8-45a7-bb85-2774bd9d51b9', '073c9211-4ef2-4861-b0cb-32be86d7ad6f', 'bf23e11e-3d5e-417f-9dc6-8b83c430055f', '392b37a9-1e15-41b4-a0c9-e3cca8aeafbe'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:10 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:10 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Flow 'volume_create_manager' (b89f24a6-5975-4abc-8975-f0d1a03e30da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0785c9-b320-4e71-840c-1343d3ee9d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0785c9-b320-4e71-840c-1343d3ee9d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d564c0a0-c6ed-4fef-bf00-78c5f75f0849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e112fd00e61741acbb351cf43f595571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8943410-5e9d-4ee3-9408-9afd5bfe360e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:11Z,use_quota=True,user_id='42fc4a12853749b0ae3b779dbfab0c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e532d0c-9aaa-49e7-bf5c-ae1dfd9cfd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e532d0c-9aaa-49e7-bf5c-ae1dfd9cfd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b17da6-450f-4db8-aa25-b6f6e24ef2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b17da6-450f-4db8-aa25-b6f6e24ef2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd564c0a0-c6ed-4fef-bf00-78c5f75f0849', 'volume_name': 'volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849', 'volume_size': 1, 'snapshot_id': 'b8943410-5e9d-4ee3-9408-9afd5bfe360e'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2d78b9-1831-4f0a-b9a9-4b8c140884c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2d78b9-1831-4f0a-b9a9-4b8c140884c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:10 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ebfa37-a2e9-48aa-80e7-85dec54cc72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:10 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Volume d564c0a0-c6ed-4fef-bf00-78c5f75f0849: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849', 'volume_size': 1, 'snapshot_id': 'b8943410-5e9d-4ee3-9408-9afd5bfe360e'} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.550s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-quobyte-b8943410-5e9d-4ee3-9408-9afd5bfe360e-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:10 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Deleted volume successfully. Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-b8943410-5e9d-4ee3-9408-9afd5bfe360e-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Creating volume d564c0a0-c6ed-4fef-bf00-78c5f75f0849 from snapshot b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-quobyte-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-06bd5e31-78f3-4798-b58b-8eece6895fe0 tempest-VolumeDependencyTests-31297999 None] Lock "cinder-219cd8c5-0c0a-4fa0-832e-e7499c8236e9-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] snapshot: b8943410-5e9d-4ee3-9408-9afd5bfe360e, volume: d564c0a0-c6ed-4fef-bf00-78c5f75f0849, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a21072-d33a-4944-8601-e7da2b894df0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:10 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e Apr 17 16:27:10 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:11 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e" returned: 0 in 0.547s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29707f28-73d1-43e2-acfb-0cf0086e1640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddff93e-52db-4872-9984-124bfb7ce8c1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:11 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 Apr 17 16:27:11 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:11 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:27:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:11 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 Apr 17 16:27:11 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:13 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" returned: 0 in 1.978s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:13 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6194776-0400-4f17-aec2-9e7e275b6f43]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:13 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 Apr 17 16:27:13 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:14 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640" returned: 0 in 0.590s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:27:14 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Converted 1024.00 MB image at 517.28 MB/s Apr 17 16:27:14 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 is being set with open permissions: ugo+rw Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:14 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 Apr 17 16:27:14 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:14 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" returned: 0 in 0.407s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" released by "_copy_volume_from_snapshot" :: held 4.062s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-b8943410-5e9d-4ee3-9408-9afd5bfe360e-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" released by "_create_volume_from_snapshot" :: held 4.081s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.096s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ebfa37-a2e9-48aa-80e7-85dec54cc72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849', 'volume_size': 1, 'snapshot_id': 'b8943410-5e9d-4ee3-9408-9afd5bfe360e'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61932b7-c6e8-4c47-bbab-f4fd1be77ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:14 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Volume volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 (d564c0a0-c6ed-4fef-bf00-78c5f75f0849): created successfully Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61932b7-c6e8-4c47-bbab-f4fd1be77ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Flow 'volume_create_manager' (b89f24a6-5975-4abc-8975-f0d1a03e30da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-1297037a-dc3e-4ca0-8a48-bfc31a96915d tempest-SnapshotDependencyTests-640087740 None] Created volume successfully. Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-b8943410-5e9d-4ee3-9408-9afd5bfe360e-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-b8943410-5e9d-4ee3-9408-9afd5bfe360e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-quobyte-29707f28-73d1-43e2-acfb-0cf0086e1640" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-29707f28-73d1-43e2-acfb-0cf0086e1640" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-quobyte-b8943410-5e9d-4ee3-9408-9afd5bfe360e" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-b8943410-5e9d-4ee3-9408-9afd5bfe360e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Deleting offline snapshot b8943410-5e9d-4ee3-9408-9afd5bfe360e of volume 29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] snapshot_file for this snap is: volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3349a8bb-837b-43fc-ad78-28468a0dd7ee]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:16 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e Apr 17 16:27:16 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:16 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29707f28-73d1-43e2-acfb-0cf0086e1640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:27:16 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82e6d9-eef3-42c7-b99e-5d6650a5723a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:16 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 Apr 17 16:27:16 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:16 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640" returned: 0 in 0.475s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:16 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e Apr 17 16:27:16 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:17 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e" returned: 0 in 0.468s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:17 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e Apr 17 16:27:17 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:17 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640.b8943410-5e9d-4ee3-9408-9afd5bfe360e" returned: 0 in 0.416s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-b8943410-5e9d-4ee3-9408-9afd5bfe360e" released by "_delete_snapshot" :: held 1.897s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-29707f28-73d1-43e2-acfb-0cf0086e1640" released by "delete_snapshot" :: held 1.907s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:17 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Created reservations ['d404bfb4-b098-4177-b287-94259da3ebcd', '3df42df7-def6-40ae-92b7-756f092c6081', '22f39707-092b-4322-b187-4dacc5366c2b', 'f0ff53ed-ffda-4f48-9470-3357d613e121'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:17 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Delete snapshot completed successfully. Apr 17 16:27:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-fda8cf01-d682-472b-b8b3-027ba8b9de0f tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-b8943410-5e9d-4ee3-9408-9afd5bfe360e-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-29707f28-73d1-43e2-acfb-0cf0086e1640-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-29707f28-73d1-43e2-acfb-0cf0086e1640-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-quobyte-29707f28-73d1-43e2-acfb-0cf0086e1640" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-29707f28-73d1-43e2-acfb-0cf0086e1640" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dc8b0a-9422-4c00-a14f-c7031848b9a7]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:18 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 Apr 17 16:27:18 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:18 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:18 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640 Apr 17 16:27:18 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:19 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-29707f28-73d1-43e2-acfb-0cf0086e1640" returned: 0 in 0.423s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-29707f28-73d1-43e2-acfb-0cf0086e1640" released by "delete_volume" :: held 0.930s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Created reservations ['10f9e979-6b2a-4d7a-b475-e63a1b519598', 'c6f9990f-2f29-4a47-bd31-f5a08df51dbe', 'e0bc37ca-1786-403d-b933-65516cebe589', 'cd420e3c-7039-41fb-b0e4-f8e4a8e5dedc'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:19 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:19 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-d564c0a0-c6ed-4fef-bf00-78c5f75f0849-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-d564c0a0-c6ed-4fef-bf00-78c5f75f0849-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "cinder-quobyte-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de20f5a-fece-4404-bb61-7aba80cbf806]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:19 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 Apr 17 16:27:19 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:19 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:19 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Deleted volume successfully. Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b8731226-38ae-4341-9756-8b9da63eb48b tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-29707f28-73d1-43e2-acfb-0cf0086e1640-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:19 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:19 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849 Apr 17 16:27:19 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:20 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" returned: 0 in 0.470s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-quobyte-d564c0a0-c6ed-4fef-bf00-78c5f75f0849" released by "delete_volume" :: held 0.980s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Created reservations ['1ff48a6f-7f6b-4927-87f8-213db37c6833', '954d810e-1122-4611-b835-b52b5d3d6cd4', '96183211-e832-495e-ae2c-9fe13020375f', 'be04d83c-ad7b-43ac-9161-6eb50eda4e7d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:20 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:20 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:20 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.474s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:20 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Deleted volume successfully. Apr 17 16:27:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36c14861-baab-457f-85c6-d51757df9602 tempest-SnapshotDependencyTests-640087740 None] Lock "cinder-d564c0a0-c6ed-4fef-bf00-78c5f75f0849-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:30 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:UPDATE=57,cinder:SELECT=35,cinder:INSERT=14,cinder:DELETE=3 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:27:30 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:DELETE=6,cinder:UPDATE=51,cinder:SELECT=42,cinder:INSERT=13 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (72bc37d4-fee4-4524-b7c7-69c28c5caab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c1b7da-e543-449b-ab78-cbe8a0b0b45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c1b7da-e543-449b-ab78-cbe8a0b0b45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930667438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a13f28d-ccf7-4caa-87d1-c935cceef89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:32Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627ec9d1-cd17-4bb2-8ad7-ef997775e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627ec9d1-cd17-4bb2-8ad7-ef997775e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b424773-d08a-41f6-af8e-1f05d6be80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b424773-d08a-41f6-af8e-1f05d6be80ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a13f28d-ccf7-4caa-87d1-c935cceef89d', 'volume_name': 'volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5269604-771a-4c1e-927f-6967fd0af24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5269604-771a-4c1e-927f-6967fd0af24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0255399b-135c-4cf5-b173-97706ddd9785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Volume 2a13f28d-ccf7-4caa-87d1-c935cceef89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d', 'volume_size': 1} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930667438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a13f28d-ccf7-4caa-87d1-c935cceef89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:32Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Creating volume 2a13f28d-ccf7-4caa-87d1-c935cceef89d {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:32 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:32 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d 1073741824 Apr 17 16:27:32 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (06526744-9ede-4e85-8aba-59307b07e026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def5c819-b474-46b2-95eb-976e2501db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def5c819-b474-46b2-95eb-976e2501db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1132141556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6718793b-a368-4307-bf5d-0503cde316ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78cfdeccc6545b1b92ea84446abad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='71eeb999752f47ce93b8e8fbf9705347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879321ba-f6c1-4943-af0a-598944b9f65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879321ba-f6c1-4943-af0a-598944b9f65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6728d6-ed54-4ec8-9ffd-2b41a46e531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6728d6-ed54-4ec8-9ffd-2b41a46e531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6718793b-a368-4307-bf5d-0503cde316ae', 'volume_name': 'volume-6718793b-a368-4307-bf5d-0503cde316ae', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf97f7f-c5b4-44f2-a1f8-8cc6ca75cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf97f7f-c5b4-44f2-a1f8-8cc6ca75cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5a460f-86d6-46a3-bcc6-d5368897916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:32 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Volume 6718793b-a368-4307-bf5d-0503cde316ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6718793b-a368-4307-bf5d-0503cde316ae', 'volume_size': 1} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (713ca1b2-3ccc-4822-b8d3-4825f5879536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:32 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e663c3a1-1e19-4d15-a8d5-65a6e222b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (2b027407-6f0b-4a04-8ec1-c0052e4bce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebbf000-5693-4ee6-b4e0-f6877cf44dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebbf000-5693-4ee6-b4e0-f6877cf44dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516963440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bbeb98-22d2-47e7-a289-366a90950728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21fefca-fb38-43d4-abe3-9b77bd542d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21fefca-fb38-43d4-abe3-9b77bd542d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a75de0-9ade-4a8a-8b79-aea526d10fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a75de0-9ade-4a8a-8b79-aea526d10fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bbeb98-22d2-47e7-a289-366a90950728', 'volume_name': 'volume-21bbeb98-22d2-47e7-a289-366a90950728', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fb789e-03ed-45de-8807-be6aaaa998a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fb789e-03ed-45de-8807-be6aaaa998a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8a3fc7-4a14-4ef7-8170-2a48f0f26224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume 21bbeb98-22d2-47e7-a289-366a90950728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bbeb98-22d2-47e7-a289-366a90950728', 'volume_size': 1} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e663c3a1-1e19-4d15-a8d5-65a6e222b21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1101302766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2252b7-c684-4074-a4fb-ce445d4153da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c493306-0977-432f-b6ab-af65e0aed927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c493306-0977-432f-b6ab-af65e0aed927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b861c55-7584-434f-8912-81d4bb71510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b861c55-7584-434f-8912-81d4bb71510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2252b7-c684-4074-a4fb-ce445d4153da', 'volume_name': 'volume-aa2252b7-c684-4074-a4fb-ce445d4153da', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ebb181-d6cd-4924-bb94-296a756b6e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ebb181-d6cd-4924-bb94-296a756b6e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99d7a8b-0888-40b5-bf04-7477f3ac2239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Volume aa2252b7-c684-4074-a4fb-ce445d4153da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2252b7-c684-4074-a4fb-ce445d4153da', 'volume_size': 1} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (62465a7e-d745-4786-a3e0-f5620243a3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8846a0ea-cb81-44e9-8adf-6060f8803cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8846a0ea-cb81-44e9-8adf-6060f8803cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-626088313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1671afbd-75fa-4f97-8f5a-f41bde4361a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc83f372-cfa0-4315-8c3f-cb532336918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc83f372-cfa0-4315-8c3f-cb532336918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735dbab2-7eb6-4fc3-91e7-f5020b8f7404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735dbab2-7eb6-4fc3-91e7-f5020b8f7404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1671afbd-75fa-4f97-8f5a-f41bde4361a1', 'volume_name': 'volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632119e8-7a99-4c93-8b83-826f0560a780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632119e8-7a99-4c93-8b83-826f0560a780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82426713-ee04-4f9d-aa68-9f13a25a18dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Volume 1671afbd-75fa-4f97-8f5a-f41bde4361a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1', 'volume_size': 1} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (4798e681-5366-40d0-b874-96b0a01e4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471dcbf6-8f54-497a-a023-c9303e51f8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471dcbf6-8f54-497a-a023-c9303e51f8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704169404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4b4e5d-872e-4a47-9fb4-8ec79f876e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdbd69a-e2fd-4145-9e18-a92b2d3ceaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdbd69a-e2fd-4145-9e18-a92b2d3ceaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1f8767-11aa-4bb2-a65e-d2b444c1ce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1f8767-11aa-4bb2-a65e-d2b444c1ce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4b4e5d-872e-4a47-9fb4-8ec79f876e80', 'volume_name': 'volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd5c075-7039-4a39-8289-1b6d8f7358a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd5c075-7039-4a39-8289-1b6d8f7358a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7848e19-7d4b-4369-a26e-3603cb2b88ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Volume fb4b4e5d-872e-4a47-9fb4-8ec79f876e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80', 'volume_size': 1} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (910fbe2e-a610-4b7e-9201-d58dc20690d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fccad87-b899-44f3-a98f-2637c6498277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fccad87-b899-44f3-a98f-2637c6498277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819387015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8502415d-d272-40ff-9aa7-918dfe20d48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc6ac85-5654-4508-9a6e-5174d79f94b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc6ac85-5654-4508-9a6e-5174d79f94b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc000a1-464f-43b5-9224-2af481f970ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc000a1-464f-43b5-9224-2af481f970ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8502415d-d272-40ff-9aa7-918dfe20d48c', 'volume_name': 'volume-8502415d-d272-40ff-9aa7-918dfe20d48c', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dd2f06-cce5-4679-916e-c8aa05c2ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dd2f06-cce5-4679-916e-c8aa05c2ca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11960b50-b7b5-4e63-b731-9b28cbd9e363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:33 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Volume 8502415d-d272-40ff-9aa7-918dfe20d48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8502415d-d272-40ff-9aa7-918dfe20d48c', 'volume_size': 1} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:33 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d 1073741824" returned: 0 in 0.829s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:33 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d Apr 17 16:27:33 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:33 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:33 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:34 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1132141556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6718793b-a368-4307-bf5d-0503cde316ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78cfdeccc6545b1b92ea84446abad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='71eeb999752f47ce93b8e8fbf9705347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Creating volume 6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:34 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0255399b-135c-4cf5-b173-97706ddd9785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:34 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae 1073741824 Apr 17 16:27:34 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a74c7-3b30-4e8d-ad3b-ca636f4d536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:34 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Volume volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d (2a13f28d-ccf7-4caa-87d1-c935cceef89d): created successfully Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a74c7-3b30-4e8d-ad3b-ca636f4d536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (72bc37d4-fee4-4524-b7c7-69c28c5caab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:34 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a1dfad6f-3885-441a-a9c0-edccbd524f33 tempest-CreateVolumesFromImageTest-1374003632 None] Created volume successfully. Apr 17 16:27:34 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.454s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:34 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae 1073741824" returned: 0 in 0.562s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:34 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae Apr 17 16:27:34 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:35 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae" returned: 0 in 0.507s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516963440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bbeb98-22d2-47e7-a289-366a90950728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Creating volume 21bbeb98-22d2-47e7-a289-366a90950728 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:35 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5a460f-86d6-46a3-bcc6-d5368897916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6718793b-a368-4307-bf5d-0503cde316ae', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7664d4a-fe72-4266-a176-cca349170247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:35 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 1073741824 Apr 17 16:27:35 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:35 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Volume volume-6718793b-a368-4307-bf5d-0503cde316ae (6718793b-a368-4307-bf5d-0503cde316ae): created successfully Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7664d4a-fe72-4266-a176-cca349170247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (06526744-9ede-4e85-8aba-59307b07e026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-562c6f28-c2cb-4c69-9a8f-b74ad5f85335 tempest-VolumeDependencyTests-963862766 None] Created volume successfully. Apr 17 16:27:35 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 1073741824" returned: 0 in 0.623s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:35 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 Apr 17 16:27:35 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:36 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728" returned: 0 in 0.544s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1101302766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2252b7-c684-4074-a4fb-ce445d4153da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Creating volume aa2252b7-c684-4074-a4fb-ce445d4153da {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:36 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8a3fc7-4a14-4ef7-8170-2a48f0f26224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bbeb98-22d2-47e7-a289-366a90950728', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:36 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da 1073741824 Apr 17 16:27:36 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097fef67-ed86-4918-b92b-433965f20867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:36 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume volume-21bbeb98-22d2-47e7-a289-366a90950728 (21bbeb98-22d2-47e7-a289-366a90950728): created successfully Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097fef67-ed86-4918-b92b-433965f20867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:36 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (2b027407-6f0b-4a04-8ec1-c0052e4bce1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:36 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-491a7901-b8c4-4298-bd61-914cf9018545 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created volume successfully. Apr 17 16:27:37 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da 1073741824" returned: 0 in 0.635s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:37 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da Apr 17 16:27:37 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (57ae3de0-477d-4e48-98cd-a2a2b0829299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60dc44a-aa8f-41db-a7e6-bc680500cf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60dc44a-aa8f-41db-a7e6-bc680500cf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447528836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7950e29-507f-4686-bef9-605060ee775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:37Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8907af4-9012-4ae6-b2f7-e33703da178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8907af4-9012-4ae6-b2f7-e33703da178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab796136-1dfc-49e0-8a27-7460b3291524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab796136-1dfc-49e0-8a27-7460b3291524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7950e29-507f-4686-bef9-605060ee775d', 'volume_name': 'volume-d7950e29-507f-4686-bef9-605060ee775d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5581b1-3068-483c-880f-7c77c46f2f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5581b1-3068-483c-880f-7c77c46f2f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b0678f-be13-41fd-8a47-52499d916622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume d7950e29-507f-4686-bef9-605060ee775d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7950e29-507f-4686-bef9-605060ee775d', 'volume_size': 1} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:37 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (a1a5dbf2-ef0a-4b10-856e-ab7352151f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aab308c-869a-4ab8-bad0-ac55e1f951ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da" returned: 0 in 0.656s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.500s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-626088313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1671afbd-75fa-4f97-8f5a-f41bde4361a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Creating volume 1671afbd-75fa-4f97-8f5a-f41bde4361a1 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:37 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aab308c-869a-4ab8-bad0-ac55e1f951ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148038650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683f8fad-70da-41fe-b7bb-e83c1b449b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 1073741824 Apr 17 16:27:37 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30f94e9-313f-48ef-8c13-86bca6dfe416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30f94e9-313f-48ef-8c13-86bca6dfe416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f003cb4f-ce29-490b-b6b0-2758899df953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f003cb4f-ce29-490b-b6b0-2758899df953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683f8fad-70da-41fe-b7bb-e83c1b449b85', 'volume_name': 'volume-683f8fad-70da-41fe-b7bb-e83c1b449b85', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b7048c-547b-4a3e-8b57-3db63d18be10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b7048c-547b-4a3e-8b57-3db63d18be10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d583b9-1232-430f-8588-f16ef71417f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume 683f8fad-70da-41fe-b7bb-e83c1b449b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683f8fad-70da-41fe-b7bb-e83c1b449b85', 'volume_size': 1} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99d7a8b-0888-40b5-bf04-7477f3ac2239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2252b7-c684-4074-a4fb-ce445d4153da', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6240da59-1b54-495d-90a4-b44f179e5d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Volume volume-aa2252b7-c684-4074-a4fb-ce445d4153da (aa2252b7-c684-4074-a4fb-ce445d4153da): created successfully Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6240da59-1b54-495d-90a4-b44f179e5d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (713ca1b2-3ccc-4822-b8d3-4825f5879536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:37 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-363a502e-a8f1-4922-9dd9-b5b48a9d3754 tempest-CreateVolumesFromImageTest-1374003632 None] Created volume successfully. Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (d3d00458-6cba-4f55-bc1c-fffeb5e71359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8712bee2-10ec-4450-9d70-aaad4090d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8712bee2-10ec-4450-9d70-aaad4090d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256282679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121e0ce0-2c61-496b-8e5e-ed9e92efb35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4e8a91-97de-41a1-ba04-052a2440c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4e8a91-97de-41a1-ba04-052a2440c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc79fd1-52a0-4fd7-a4cf-036cb5fc69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc79fd1-52a0-4fd7-a4cf-036cb5fc69ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '121e0ce0-2c61-496b-8e5e-ed9e92efb35a', 'volume_name': 'volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332ea565-2f2b-4cc0-81b3-8478c12c22c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332ea565-2f2b-4cc0-81b3-8478c12c22c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b350a18-c1a4-4b90-8a91-216b1d1fd6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:37 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume 121e0ce0-2c61-496b-8e5e-ed9e92efb35a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a', 'volume_size': 1} Apr 17 16:27:37 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (d41f5dc0-463f-4d2c-a815-c4bf46f75152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71519494-2f53-4483-a9fb-918da9bf502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71519494-2f53-4483-a9fb-918da9bf502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2015823668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e3e504-845d-4465-839d-6f675bf4ac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6d0dc0-a379-42b1-bc9d-8ae80164d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6d0dc0-a379-42b1-bc9d-8ae80164d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3befe39-d17c-4667-b54e-552d6351aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3befe39-d17c-4667-b54e-552d6351aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e3e504-845d-4465-839d-6f675bf4ac38', 'volume_name': 'volume-10e3e504-845d-4465-839d-6f675bf4ac38', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0814e46-758d-43a1-86e8-a46e12612d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0814e46-758d-43a1-86e8-a46e12612d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e71787-8e83-4914-9099-c65734651d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume 10e3e504-845d-4465-839d-6f675bf4ac38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e3e504-845d-4465-839d-6f675bf4ac38', 'volume_size': 1} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (f5186081-f24b-4235-b868-8c954e82f8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b544796d-ce24-474a-aba6-8dc8630548a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b544796d-ce24-474a-aba6-8dc8630548a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546184224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d229ee-ead8-4b0a-94d5-09c068aae32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1679a4dd-760f-47a4-ba06-e868e370049d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1679a4dd-760f-47a4-ba06-e868e370049d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b95c07-0eb6-4c5b-b63f-c8d5ed903827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b95c07-0eb6-4c5b-b63f-c8d5ed903827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d229ee-ead8-4b0a-94d5-09c068aae32f', 'volume_name': 'volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f268874-9b08-4aaf-b75a-482bb01ab101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f268874-9b08-4aaf-b75a-482bb01ab101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b750f8a-ac66-4df5-8874-578cd445f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume b1d229ee-ead8-4b0a-94d5-09c068aae32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f', 'volume_size': 1} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 1073741824" returned: 0 in 0.648s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:38 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 Apr 17 16:27:38 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:38 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1" returned: 0 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.572s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704169404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4b4e5d-872e-4a47-9fb4-8ec79f876e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Creating volume fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:38 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82426713-ee04-4f9d-aa68-9f13a25a18dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4414a0ea-55df-4587-a1da-f2f8db57d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:38 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Volume volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 (1671afbd-75fa-4f97-8f5a-f41bde4361a1): created successfully Apr 17 16:27:38 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 1073741824 Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4414a0ea-55df-4587-a1da-f2f8db57d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:38 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:38 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (62465a7e-d745-4786-a3e0-f5620243a3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:39 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6212b0af-89ec-4d5e-b9c6-25c577fc2199 tempest-CreateVolumesFromImageTest-1374003632 None] Created volume successfully. Apr 17 16:27:39 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 1073741824" returned: 0 in 0.589s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:39 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:39 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 Apr 17 16:27:39 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:40 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80" returned: 0 in 0.474s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.528s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819387015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8502415d-d272-40ff-9aa7-918dfe20d48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76176a7949884f87a926b95dd3230d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:33Z,use_quota=True,user_id='2dfb1a9ee6b249a09d2e1bea74c29ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Creating volume 8502415d-d272-40ff-9aa7-918dfe20d48c {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:40 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7848e19-7d4b-4369-a26e-3603cb2b88ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:40 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c 1073741824 Apr 17 16:27:40 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7beca0-76db-44a7-bb39-89eca01b2d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:40 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Volume volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 (fb4b4e5d-872e-4a47-9fb4-8ec79f876e80): created successfully Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7beca0-76db-44a7-bb39-89eca01b2d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (4798e681-5366-40d0-b874-96b0a01e4811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:40 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-58790b41-60ce-4532-bd42-a11f80b4cab2 tempest-CreateVolumesFromImageTest-1374003632 None] Created volume successfully. Apr 17 16:27:40 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c 1073741824" returned: 0 in 0.585s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:40 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:40 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c Apr 17 16:27:40 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:41 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c" returned: 0 in 0.451s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.893s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Creating offline snapshot 7eeb25e7-8479-4599-9623-45597839791b of volume 6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11960b50-b7b5-4e63-b731-9b28cbd9e363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8502415d-d272-40ff-9aa7-918dfe20d48c', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fa5fa1-9718-45dd-858d-151a08362676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c4edc2-a47e-4d00-829c-420463f16619]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:41 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Volume volume-8502415d-d272-40ff-9aa7-918dfe20d48c (8502415d-d272-40ff-9aa7-918dfe20d48c): created successfully Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fa5fa1-9718-45dd-858d-151a08362676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Flow 'volume_create_manager' (910fbe2e-a610-4b7e-9201-d58dc20690d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:41 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c26e1797-3e06-4073-acc7-5d9686edf8b0 tempest-CreateVolumesFromImageTest-1374003632 None] Created volume successfully. Apr 17 16:27:41 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae Apr 17 16:27:41 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:41 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae" returned: 0 in 0.523s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:41 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:41 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b 1G Apr 17 16:27:41 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-8502415d-d272-40ff-9aa7-918dfe20d48c-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-8502415d-d272-40ff-9aa7-918dfe20d48c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:42 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b 1G" returned: 0 in 0.534s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6718793b-a368-4307-bf5d-0503cde316ae -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:42 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6718793b-a368-4307-bf5d-0503cde316ae -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b Apr 17 16:27:42 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-quobyte-8502415d-d272-40ff-9aa7-918dfe20d48c" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-8502415d-d272-40ff-9aa7-918dfe20d48c" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ea6dac-a662-459f-a0ce-02c9e9effda0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:42 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c Apr 17 16:27:42 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:42 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6718793b-a368-4307-bf5d-0503cde316ae -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b" returned: 0 in 0.538s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:42 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b is being set with open permissions: ugo+rw Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:42 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b Apr 17 16:27:42 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:42 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c" returned: 0 in 0.586s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:42 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:42 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c Apr 17 16:27:42 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:43 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b" returned: 0 in 0.582s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:43 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-8502415d-d272-40ff-9aa7-918dfe20d48c" returned: 0 in 0.509s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-8502415d-d272-40ff-9aa7-918dfe20d48c" released by "delete_volume" :: held 1.126s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:43 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.info Apr 17 16:27:43 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Created reservations ['302061e6-0d0b-4269-b937-9d31d8a69943', '58dd8e85-239f-4951-9088-bda0f39c5b71', 'b8a841ad-dea7-4905-8df9-b743cd437f99', '14ab4d0e-5c75-46cb-ac19-5e054e98c80f'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:43 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:43 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:43 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.info" returned: 0 in 0.573s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:43 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.info is being set with open permissions: ugo+rw Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:43 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.info Apr 17 16:27:43 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:43 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.516s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:43 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:44 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Deleted volume successfully. Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a3cf6228-b9b9-454f-a0d5-447fbf3db1ad tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-8502415d-d272-40ff-9aa7-918dfe20d48c-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:44 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.info" returned: 0 in 0.458s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.934s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447528836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7950e29-507f-4686-bef9-605060ee775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:37Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Creating volume d7950e29-507f-4686-bef9-605060ee775d {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:44 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:44 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d 1073741824 Apr 17 16:27:44 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:44 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-85237e91-1853-4e3c-a423-a9aa2ffc4ebe tempest-VolumeDependencyTests-963862766 None] Create snapshot completed successfully Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-quobyte-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80" acquired by "delete_volume" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[267cb7bd-88ec-46db-8204-738db3b3c344]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:44 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 Apr 17 16:27:44 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (f28b5e78-a2d2-410c-ba2b-3f098b8a5002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7106bd76-c70f-477b-810a-9e1ddf9c6ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7106bd76-c70f-477b-810a-9e1ddf9c6ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1555589264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d461f085-4520-4d9f-81fb-88b742a2a261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78cfdeccc6545b1b92ea84446abad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7eeb25e7-8479-4599-9623-45597839791b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:45Z,use_quota=True,user_id='71eeb999752f47ce93b8e8fbf9705347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3150cf-ed5a-4f06-9f5c-a7de8baa717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3150cf-ed5a-4f06-9f5c-a7de8baa717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa8c4d6-a7ce-47d4-8ffe-133d7b6c6c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa8c4d6-a7ce-47d4-8ffe-133d7b6c6c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd461f085-4520-4d9f-81fb-88b742a2a261', 'volume_name': 'volume-d461f085-4520-4d9f-81fb-88b742a2a261', 'volume_size': 1, 'snapshot_id': '7eeb25e7-8479-4599-9623-45597839791b'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d674198d-851c-49a9-824f-a93d95b813a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d674198d-851c-49a9-824f-a93d95b813a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c622ce9-7b69-428b-aaca-dc601b3bc3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:44 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Volume d461f085-4520-4d9f-81fb-88b742a2a261: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d461f085-4520-4d9f-81fb-88b742a2a261', 'volume_size': 1, 'snapshot_id': '7eeb25e7-8479-4599-9623-45597839791b'} Apr 17 16:27:44 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:45 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d 1073741824" returned: 0 in 0.680s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:45 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d Apr 17 16:27:45 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:45 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80" returned: 0 in 0.610s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:45 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80 Apr 17 16:27:45 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:45 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d" returned: 0 in 0.418s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.738s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148038650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683f8fad-70da-41fe-b7bb-e83c1b449b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Creating volume 683f8fad-70da-41fe-b7bb-e83c1b449b85 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:45 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b0678f-be13-41fd-8a47-52499d916622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7950e29-507f-4686-bef9-605060ee775d', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc2e85d-892a-4db0-9f38-94ffece8620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:45 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume volume-d7950e29-507f-4686-bef9-605060ee775d (d7950e29-507f-4686-bef9-605060ee775d): created successfully Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc2e85d-892a-4db0-9f38-94ffece8620c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:45 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 1073741824 Apr 17 16:27:45 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (57ae3de0-477d-4e48-98cd-a2a2b0829299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:45 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5f67bbdc-a2f3-418a-b9a7-3af958d41cb7 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created volume successfully. Apr 17 16:27:45 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80" returned: 0 in 0.606s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80" released by "delete_volume" :: held 1.254s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Created reservations ['c888c72d-e458-4528-adaf-f878bb6406b1', 'daff1594-c20c-4476-8f0e-1219f5cda2c1', '074eb91a-2f95-48b1-9d1b-84098288f0ee', 'f601668f-9e08-4f5c-b772-748761b902ba'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:45 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:45 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:45 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:46 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 1073741824" returned: 0 in 0.651s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:46 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 Apr 17 16:27:46 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:46 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.447s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:46 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Deleted volume successfully. Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-abdb046c-ec8e-4be6-9709-3c194bbfa6e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-fb4b4e5d-872e-4a47-9fb4-8ec79f876e80-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Flow 'volume_create_manager' (f7f7be52-8f6e-4946-965f-40413278e756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eef69cc-413a-47f5-8d90-35f245c149a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eef69cc-413a-47f5-8d90-35f245c149a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-636517254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ea2504-fd90-4885-8adb-511886cb2423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f5d24c2d24d9cb6c4597fee18d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:46Z,use_quota=True,user_id='c9ee0b1058734455a6478e557530eb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e410e0e-7237-4c57-b9cc-da1bd6fc8068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e410e0e-7237-4c57-b9cc-da1bd6fc8068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b62158-7bcc-4f8a-838d-276ea955bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b62158-7bcc-4f8a-838d-276ea955bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ea2504-fd90-4885-8adb-511886cb2423', 'volume_name': 'volume-07ea2504-fd90-4885-8adb-511886cb2423', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6683f0b-eec5-41c5-9ffa-d11fec0021db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6683f0b-eec5-41c5-9ffa-d11fec0021db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2479ff8b-7299-4afe-94d3-6aa244d2e94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:46 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Volume 07ea2504-fd90-4885-8adb-511886cb2423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ea2504-fd90-4885-8adb-511886cb2423', 'volume_size': 1} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-1671afbd-75fa-4f97-8f5a-f41bde4361a1-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-1671afbd-75fa-4f97-8f5a-f41bde4361a1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-quobyte-1671afbd-75fa-4f97-8f5a-f41bde4361a1" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-1671afbd-75fa-4f97-8f5a-f41bde4361a1" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5a24b4-af3e-4506-9f08-a0471031600b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:46 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85" returned: 0 in 0.461s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:46 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 Apr 17 16:27:46 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.767s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256282679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121e0ce0-2c61-496b-8e5e-ed9e92efb35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Creating volume 121e0ce0-2c61-496b-8e5e-ed9e92efb35a {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:46 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d583b9-1232-430f-8588-f16ef71417f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683f8fad-70da-41fe-b7bb-e83c1b449b85', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2abc28a-1366-443f-b9e0-ae78d1531fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:46 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a 1073741824 Apr 17 16:27:46 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:46 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 (683f8fad-70da-41fe-b7bb-e83c1b449b85): created successfully Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2abc28a-1366-443f-b9e0-ae78d1531fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:46 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (a1a5dbf2-ef0a-4b10-856e-ab7352151f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:46 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-c5d7a960-518e-4f08-b8c5-b44c53dee24e tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created volume successfully. Apr 17 16:27:47 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1" returned: 0 in 0.506s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:47 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1 Apr 17 16:27:47 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:47 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a 1073741824" returned: 0 in 0.515s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:47 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a Apr 17 16:27:47 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:47 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1671afbd-75fa-4f97-8f5a-f41bde4361a1" returned: 0 in 0.425s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-1671afbd-75fa-4f97-8f5a-f41bde4361a1" released by "delete_volume" :: held 0.954s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Created reservations ['c7451c7d-72a6-49ed-894d-e15ec6849320', '5a8f3d53-6eff-4c51-940e-fb279de9260a', '6bbc1c7b-baeb-4160-8bbd-e7e10bc14489', 'e6eac23b-eb6e-4b92-9d1f-25b535b77cc0'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:47 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:47 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:47 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a" returned: 0 in 0.434s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.524s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2015823668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e3e504-845d-4465-839d-6f675bf4ac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Creating volume 10e3e504-845d-4465-839d-6f675bf4ac38 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:47 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b350a18-c1a4-4b90-8a91-216b1d1fd6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d156595d-fcb8-4c93-a7c8-8539ab0078df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:47 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 1073741824 Apr 17 16:27:47 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-aa2252b7-c684-4074-a4fb-ce445d4153da-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:47 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a (121e0ce0-2c61-496b-8e5e-ed9e92efb35a): created successfully Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d156595d-fcb8-4c93-a7c8-8539ab0078df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (d3d00458-6cba-4f55-bc1c-fffeb5e71359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-aa2252b7-c684-4074-a4fb-ce445d4153da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:47 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a7768e0f-b731-4b2e-a205-ea33b8a01f8b tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created volume successfully. Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-quobyte-aa2252b7-c684-4074-a4fb-ce445d4153da" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-aa2252b7-c684-4074-a4fb-ce445d4153da" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4525f863-c0d3-41d9-8e5c-8a71fa578ee5]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:47 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:47 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da Apr 17 16:27:47 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:48 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.480s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:48 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Deleted volume successfully. Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b134c969-004c-4937-a5a0-c85e017a15e4 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-1671afbd-75fa-4f97-8f5a-f41bde4361a1-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:48 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 1073741824" returned: 0 in 0.553s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:48 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 Apr 17 16:27:48 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:48 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da" returned: 0 in 0.492s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:48 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da Apr 17 16:27:48 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:48 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38" returned: 0 in 0.426s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.290s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546184224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d229ee-ead8-4b0a-94d5-09c068aae32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc443c1943141f48f46f2d54b93399e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:38Z,use_quota=True,user_id='9b887dd76e34457496f4327a192b4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Creating volume b1d229ee-ead8-4b0a-94d5-09c068aae32f {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:48 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:48 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f 1073741824 Apr 17 16:27:48 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e71787-8e83-4914-9099-c65734651d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e3e504-845d-4465-839d-6f675bf4ac38', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aee66fb-df0a-4b7c-8361-b24e4001f072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:48 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume volume-10e3e504-845d-4465-839d-6f675bf4ac38 (10e3e504-845d-4465-839d-6f675bf4ac38): created successfully Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aee66fb-df0a-4b7c-8361-b24e4001f072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (d41f5dc0-463f-4d2c-a815-c4bf46f75152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:48 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-4b95256b-b40b-4d43-82e7-aa891f53b47d tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created volume successfully. Apr 17 16:27:48 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa2252b7-c684-4074-a4fb-ce445d4153da" returned: 0 in 0.464s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-aa2252b7-c684-4074-a4fb-ce445d4153da" released by "delete_volume" :: held 0.985s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Created reservations ['160bb9fc-d2ab-440a-a6da-97646ef9f55d', 'a92d3951-6565-4462-b310-c9c5168f532d', '6324e9f1-a2e3-4964-97be-aa8082a978a2', '818d72b3-4821-45de-aa92-08828ef9f910'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:48 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:48 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:48 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:49 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f 1073741824" returned: 0 in 0.508s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:49 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f Apr 17 16:27:49 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:49 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.450s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:49 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Deleted volume successfully. Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-f248a1b8-0461-4298-8651-ad50dd5a94db tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-aa2252b7-c684-4074-a4fb-ce445d4153da-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:49 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f" returned: 0 in 0.413s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.683s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-7eeb25e7-8479-4599-9623-45597839791b-d461f085-4520-4d9f-81fb-88b742a2a261" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b750f8a-ac66-4df5-8874-578cd445f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0beaedc4-1141-4dc6-97f2-0200c74c99f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:49 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Volume volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f (b1d229ee-ead8-4b0a-94d5-09c068aae32f): created successfully Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0beaedc4-1141-4dc6-97f2-0200c74c99f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Flow 'volume_create_manager' (f5186081-f24b-4235-b868-8c954e82f8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-7eeb25e7-8479-4599-9623-45597839791b-d461f085-4520-4d9f-81fb-88b742a2a261" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Creating volume d461f085-4520-4d9f-81fb-88b742a2a261 from snapshot 7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-d461f085-4520-4d9f-81fb-88b742a2a261" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:49 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-3f5651dc-fee5-43ca-bae2-2f8c7d1cf4f2 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created volume successfully. Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-d461f085-4520-4d9f-81fb-88b742a2a261" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] snapshot: 7eeb25e7-8479-4599-9623-45597839791b, volume: d461f085-4520-4d9f-81fb-88b742a2a261, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337ca13-79f4-4def-b7cc-26da4185dd65]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:49 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b Apr 17 16:27:49 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-2a13f28d-ccf7-4caa-87d1-c935cceef89d-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-2a13f28d-ccf7-4caa-87d1-c935cceef89d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "cinder-quobyte-2a13f28d-ccf7-4caa-87d1-c935cceef89d" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:49 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-2a13f28d-ccf7-4caa-87d1-c935cceef89d" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24fd564-7708-433f-931b-875d15adef56]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:50 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d Apr 17 16:27:50 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-b1d229ee-ead8-4b0a-94d5-09c068aae32f-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-b1d229ee-ead8-4b0a-94d5-09c068aae32f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:50 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b" returned: 0 in 0.532s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-quobyte-b1d229ee-ead8-4b0a-94d5-09c068aae32f" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6718793b-a368-4307-bf5d-0503cde316ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[daba2a6f-a604-4517-89cd-fa3884fe080f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-b1d229ee-ead8-4b0a-94d5-09c068aae32f" acquired by "delete_volume" :: waited 0.025s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96f4804-e1be-42fb-af53-c7c294bb2993]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:50 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae Apr 17 16:27:50 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:50 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f Apr 17 16:27:50 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:50 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d" returned: 0 in 0.527s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:50 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d Apr 17 16:27:50 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:50 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae" returned: 0 in 0.497s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:50 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f" returned: 0 in 0.491s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:50 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 Apr 17 16:27:50 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:50 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f Apr 17 16:27:50 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:50 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-2a13f28d-ccf7-4caa-87d1-c935cceef89d" returned: 0 in 0.436s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:50 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-quobyte-2a13f28d-ccf7-4caa-87d1-c935cceef89d" released by "delete_volume" :: held 0.997s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Created reservations ['6c9afe3f-52f1-4988-a696-65c2f094961d', '56094d33-cdfb-4a90-956a-854ea57b38cd', '3946b614-d04f-46f3-bea5-37aef2c03361', '7a583254-7285-42ab-b2e3-b580139d3fc4'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:51 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:51 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:51 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-b1d229ee-ead8-4b0a-94d5-09c068aae32f" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-b1d229ee-ead8-4b0a-94d5-09c068aae32f" released by "delete_volume" :: held 1.069s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created reservations ['e464d8f2-5ce3-4039-920b-49fb6a27a456', '5ad9b670-3864-4660-9b4c-5d594a09c168', 'dfdb8923-538d-41d3-86ca-a9e10775f3c3', 'dbdc1f40-6731-4bac-bab5-3720588e42c7'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:51 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:51 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:51 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:52 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:52 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 1.080s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:52 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:52 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Deleted volume successfully. Apr 17 16:27:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6da5d2f5-0803-478d-82d8-33959f798507 tempest-CreateVolumesFromImageTest-1374003632 None] Lock "cinder-2a13f28d-ccf7-4caa-87d1-c935cceef89d-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-10e3e504-845d-4465-839d-6f675bf4ac38-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:52 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-10e3e504-845d-4465-839d-6f675bf4ac38-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-quobyte-10e3e504-845d-4465-839d-6f675bf4ac38" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-10e3e504-845d-4465-839d-6f675bf4ac38" acquired by "delete_volume" :: waited 0.023s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d0c2b-d6e4-4f31-8e71-0089b415308d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:53 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 1.579s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:53 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Deleted volume successfully. Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-82004ab3-2476-4f76-b8d1-4ce1cc4a21d1 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-b1d229ee-ead8-4b0a-94d5-09c068aae32f-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:53 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261" returned: 0 in 2.457s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44bc619-c1c9-407b-9696-d4b004741b34]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:53 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:53 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:53 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae Apr 17 16:27:53 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:53 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38" returned: 0 in 0.578s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:53 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38 Apr 17 16:27:53 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:53 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae" returned: 0 in 0.727s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:27:53 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Converted 1024.00 MB image at 416.65 MB/s Apr 17 16:27:53 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 is being set with open permissions: ugo+rw Apr 17 16:27:53 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:54 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 Apr 17 16:27:54 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:54 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-10e3e504-845d-4465-839d-6f675bf4ac38" returned: 0 in 0.506s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-10e3e504-845d-4465-839d-6f675bf4ac38" released by "delete_volume" :: held 1.126s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created reservations ['fdd456f1-ea35-44c4-a47d-c86b36a4bc22', '00b48dd0-812e-4138-be5e-72f2c53457a5', '758300f8-4702-4486-8a67-4a5da20f366b', 'cbe48dcd-b9d0-43b6-a8b3-53d02ceec76c'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:54 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:54 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:54 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261" returned: 0 in 0.488s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-d461f085-4520-4d9f-81fb-88b742a2a261" released by "_copy_volume_from_snapshot" :: held 4.764s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-7eeb25e7-8479-4599-9623-45597839791b-d461f085-4520-4d9f-81fb-88b742a2a261" released by "_create_volume_from_snapshot" :: held 4.787s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.823s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.955s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-636517254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ea2504-fd90-4885-8adb-511886cb2423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f5d24c2d24d9cb6c4597fee18d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:46Z,use_quota=True,user_id='c9ee0b1058734455a6478e557530eb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Creating volume 07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:54 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:54 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 1073741824 Apr 17 16:27:54 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c622ce9-7b69-428b-aaca-dc601b3bc3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d461f085-4520-4d9f-81fb-88b742a2a261', 'volume_size': 1, 'snapshot_id': '7eeb25e7-8479-4599-9623-45597839791b'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a0734e-c22a-43f1-a531-33ed0e25a03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Volume volume-d461f085-4520-4d9f-81fb-88b742a2a261 (d461f085-4520-4d9f-81fb-88b742a2a261): created successfully Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a0734e-c22a-43f1-a531-33ed0e25a03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (f28b5e78-a2d2-410c-ba2b-3f098b8a5002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:54 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-433da72a-d4b3-4f76-baa6-549cdb80d889 tempest-VolumeDependencyTests-963862766 None] Created volume successfully. Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (30c80e61-ce4f-46bb-9d8a-11c7cee6789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a8c0c-42a0-42ce-951e-bc5f7dc2d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a8c0c-42a0-42ce-951e-bc5f7dc2d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447636242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f7e04-2567-4eea-8780-7be7b2bdb2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:55Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a32d149-3434-406c-aa32-2cae049088a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a32d149-3434-406c-aa32-2cae049088a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650bc08f-d489-4be9-82d1-87c359be5712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650bc08f-d489-4be9-82d1-87c359be5712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337f7e04-2567-4eea-8780-7be7b2bdb2bc', 'volume_name': 'volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d094b470-1c93-4c6b-a0b8-6864f5a10d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d094b470-1c93-4c6b-a0b8-6864f5a10d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a52919-2958-432c-86a2-ecf4fffe1e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:54 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume 337f7e04-2567-4eea-8780-7be7b2bdb2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc', 'volume_size': 1} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-7eeb25e7-8479-4599-9623-45597839791b-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-7eeb25e7-8479-4599-9623-45597839791b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-6718793b-a368-4307-bf5d-0503cde316ae" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-6718793b-a368-4307-bf5d-0503cde316ae" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-7eeb25e7-8479-4599-9623-45597839791b" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-7eeb25e7-8479-4599-9623-45597839791b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Deleting offline snapshot 7eeb25e7-8479-4599-9623-45597839791b of volume 6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] snapshot_file for this snap is: volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf6afa-5bd1-406b-a50b-df5750c25fe2]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:54 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.473s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:54 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Deleted volume successfully. Apr 17 16:27:54 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-440b54bd-a7e3-449e-9dc7-af12720ab5e0 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-10e3e504-845d-4465-839d-6f675bf4ac38-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:54 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b Apr 17 16:27:54 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:55 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 1073741824" returned: 0 in 0.542s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-121e0ce0-2c61-496b-8e5e-ed9e92efb35a-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-121e0ce0-2c61-496b-8e5e-ed9e92efb35a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:55 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 Apr 17 16:27:55 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-quobyte-121e0ce0-2c61-496b-8e5e-ed9e92efb35a" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-121e0ce0-2c61-496b-8e5e-ed9e92efb35a" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c0dbe7-b9e0-4ed1-8ce8-763d7afcccd9]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:55 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a Apr 17 16:27:55 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:55 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b" returned: 0 in 0.505s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6718793b-a368-4307-bf5d-0503cde316ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e267c8-261f-41ff-b44c-b995fac97fe1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:55 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae Apr 17 16:27:55 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:55 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423" returned: 0 in 0.428s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447636242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f7e04-2567-4eea-8780-7be7b2bdb2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:27:55Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Creating volume 337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:27:55 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2479ff8b-7299-4afe-94d3-6aa244d2e94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ea2504-fd90-4885-8adb-511886cb2423', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:55 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc 1073741824 Apr 17 16:27:55 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d7c85b-a75a-4314-84fa-627b8fd2b067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:55 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Volume volume-07ea2504-fd90-4885-8adb-511886cb2423 (07ea2504-fd90-4885-8adb-511886cb2423): created successfully Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d7c85b-a75a-4314-84fa-627b8fd2b067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Flow 'volume_create_manager' (f7f7be52-8f6e-4946-965f-40413278e756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:55 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-efdee713-b795-4207-9303-8bdecc584d31 tempest-SnapshotDependencyTests-410761406 None] Created volume successfully. Apr 17 16:27:55 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a" returned: 0 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:55 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a Apr 17 16:27:55 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:55 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae" returned: 0 in 0.497s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:55 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:55 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b Apr 17 16:27:55 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:56 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc 1073741824" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:56 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:56 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc Apr 17 16:27:56 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-121e0ce0-2c61-496b-8e5e-ed9e92efb35a" returned: 0 in 0.439s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-121e0ce0-2c61-496b-8e5e-ed9e92efb35a" released by "delete_volume" :: held 0.961s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created reservations ['369c5856-4c12-4d93-92fa-685e7fb04844', '2f3b7b6b-95c6-47fa-ba1f-9199aa79192a', 'f0dd83be-b1f1-4178-8842-41efebe2d69a', 'd11c20b1-2944-4211-afdd-735a632e1631'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:56 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:56 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:56 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b" returned: 0 in 0.583s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:56 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b Apr 17 16:27:56 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:56 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc" returned: 0 in 0.449s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.089s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Creating offline snapshot 9eb4b8af-f0af-402d-827b-3d61982868f1 of volume 07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a52919-2958-432c-86a2-ecf4fffe1e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c8cf9-5ff7-4518-82a6-bdf8ddd6121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f1c8bc-6ef6-4b15-9399-4df4d943b924]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:56 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc (337f7e04-2567-4eea-8780-7be7b2bdb2bc): created successfully Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c8cf9-5ff7-4518-82a6-bdf8ddd6121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (30c80e61-ce4f-46bb-9d8a-11c7cee6789e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:27:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-aa1c8a06-9079-46ab-b283-b45188c7edf3 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created volume successfully. Apr 17 16:27:56 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 Apr 17 16:27:56 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:56 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Deleted volume successfully. Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-6459299c-fae2-4a80-ba0c-37e5bd249787 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-121e0ce0-2c61-496b-8e5e-ed9e92efb35a-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:56 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae.7eeb25e7-8479-4599-9623-45597839791b" returned: 0 in 0.529s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-7eeb25e7-8479-4599-9623-45597839791b" released by "_delete_snapshot" :: held 2.165s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-6718793b-a368-4307-bf5d-0503cde316ae" released by "delete_snapshot" :: held 2.177s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Created reservations ['cf2e8958-fba9-4177-8716-6ec3cd9bfa6c', '576eec72-313d-4325-9eb7-b811d4a49c61', '1c9089d7-2e3a-406a-a298-e7391939247c', '18dae5df-db3e-4b82-9e7f-09bf9f07055a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:56 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Delete snapshot completed successfully. Apr 17 16:27:56 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-0df28a80-cde5-49d7-adf7-f3b7b2e038b5 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-7eeb25e7-8479-4599-9623-45597839791b-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:57 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423" returned: 0 in 0.515s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:57 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 1G Apr 17 16:27:57 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-683f8fad-70da-41fe-b7bb-e83c1b449b85-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-683f8fad-70da-41fe-b7bb-e83c1b449b85-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-quobyte-683f8fad-70da-41fe-b7bb-e83c1b449b85" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-683f8fad-70da-41fe-b7bb-e83c1b449b85" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86bcf71-0b7a-49cc-9dc9-856ddd30fea1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:57 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 Apr 17 16:27:57 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:57 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 1G" returned: 0 in 0.524s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07ea2504-fd90-4885-8adb-511886cb2423 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:57 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07ea2504-fd90-4885-8adb-511886cb2423 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 Apr 17 16:27:57 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:57 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85" returned: 0 in 0.474s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:57 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85 Apr 17 16:27:57 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-6718793b-a368-4307-bf5d-0503cde316ae-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-6718793b-a368-4307-bf5d-0503cde316ae-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-6718793b-a368-4307-bf5d-0503cde316ae" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-6718793b-a368-4307-bf5d-0503cde316ae" acquired by "delete_volume" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ba26df-853f-4856-9f69-3193f7ec83b8]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:57 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:57 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae Apr 17 16:27:57 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:58 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07ea2504-fd90-4885-8adb-511886cb2423 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1" returned: 0 in 0.470s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:58 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 is being set with open permissions: ugo+rw Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:58 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 Apr 17 16:27:58 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:58 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-683f8fad-70da-41fe-b7bb-e83c1b449b85" returned: 0 in 0.460s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-683f8fad-70da-41fe-b7bb-e83c1b449b85" released by "delete_volume" :: held 0.955s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created reservations ['de38a896-dc56-44f3-b35a-867d2e9c1e33', 'b1c296e8-0386-4fe7-ba7f-30fc7a07fc3c', '7e3812f0-98e2-48e3-8b93-1ed4cb5c7c2f', '689b744f-ebab-4208-addb-91ba9a361583'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:58 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:58 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-d7950e29-507f-4686-bef9-605060ee775d-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-d7950e29-507f-4686-bef9-605060ee775d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-quobyte-d7950e29-507f-4686-bef9-605060ee775d" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-d7950e29-507f-4686-bef9-605060ee775d" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1d63eb-eb10-4c34-a73a-cba1e59f3d26]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:58 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:58 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d Apr 17 16:27:58 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae" returned: 0 in 0.571s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:58 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae Apr 17 16:27:58 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:58 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1" returned: 0 in 0.469s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:58 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.info Apr 17 16:27:58 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:58 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:58 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Deleted volume successfully. Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-b0236fcf-8946-4435-8184-0005ce9fddeb tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-683f8fad-70da-41fe-b7bb-e83c1b449b85-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:58 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d" returned: 0 in 0.528s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:58 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6718793b-a368-4307-bf5d-0503cde316ae" returned: 0 in 0.456s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-6718793b-a368-4307-bf5d-0503cde316ae" released by "delete_volume" :: held 1.061s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:58 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d Apr 17 16:27:58 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:58 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Created reservations ['29a62be4-93c5-49be-91cd-d02abcbf1f33', '6d359cc2-2086-45fb-912b-c09ea992477d', '891a0a60-400b-474a-91d4-44b8d3ff0a59', 'bd5a86cc-15f0-4c48-865c-440fbcb3d5c3'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:59 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.info" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:59 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.info is being set with open permissions: ugo+rw Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:59 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.info Apr 17 16:27:59 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:59 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:59 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:59 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d7950e29-507f-4686-bef9-605060ee775d" returned: 0 in 0.414s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-d7950e29-507f-4686-bef9-605060ee775d" released by "delete_volume" :: held 0.965s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created reservations ['66779ec8-3370-447e-949c-3b92cb3e8dd8', 'e45c5229-9352-471c-9103-2fb279092389', 'e47d40e5-6734-4d2e-a40e-f51cc0f9edb7', '27384819-e1b8-459d-8f72-a7a689bd52d5'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:59 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.info" returned: 0 in 0.430s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.971s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:27:59 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:27:59 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.606s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:27:59 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-21bbeb98-22d2-47e7-a289-366a90950728-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Creating offline snapshot ddd3c479-d654-4d8a-a83b-e4f5723f5e3d of volume 337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb40465-7fd5-4f35-aa85-0931ccd13b4a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-6edc1d31-00a0-4736-8f2c-0481131c42e3 tempest-SnapshotDependencyTests-410761406 None] Create snapshot completed successfully Apr 17 16:27:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Deleted volume successfully. Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-21bbeb98-22d2-47e7-a289-366a90950728-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-46a44e1b-708b-40a2-b351-e72ae4016563 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-6718793b-a368-4307-bf5d-0503cde316ae-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "cinder-quobyte-21bbeb98-22d2-47e7-a289-366a90950728" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:27:59 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc Apr 17 16:27:59 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-21bbeb98-22d2-47e7-a289-366a90950728" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c26726-22d7-47a8-9e11-530c952b472c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:27:59 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 Apr 17 16:27:59 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:27:59 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:27:59 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Deleted volume successfully. Apr 17 16:27:59 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-35646904-dd96-41e3-981b-c32b5c332ff9 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-d7950e29-507f-4686-bef9-605060ee775d-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:00 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc" returned: 0 in 0.522s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:00 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d 1G Apr 17 16:28:00 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:00 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728" returned: 0 in 0.473s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:00 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728 Apr 17 16:28:00 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (9db47f7f-8179-4a46-b56e-f56a33a00c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed38da1b-0119-479a-9248-b2717187e9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed38da1b-0119-479a-9248-b2717187e9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-371603926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa78a13d-0b66-41b3-a97b-577449dfcc46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78cfdeccc6545b1b92ea84446abad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:00Z,use_quota=True,user_id='71eeb999752f47ce93b8e8fbf9705347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb4b5ba-d2f3-4ba8-a87d-bf51003040d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb4b5ba-d2f3-4ba8-a87d-bf51003040d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cd70d0-69fd-4453-a7d0-33412c770bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cd70d0-69fd-4453-a7d0-33412c770bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa78a13d-0b66-41b3-a97b-577449dfcc46', 'volume_name': 'volume-aa78a13d-0b66-41b3-a97b-577449dfcc46', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4501deac-de3d-43cb-9130-77956e94ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4501deac-de3d-43cb-9130-77956e94ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf591f33-6a4f-46e7-8342-2631f71314de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Volume aa78a13d-0b66-41b3-a97b-577449dfcc46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa78a13d-0b66-41b3-a97b-577449dfcc46', 'volume_size': 1} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:00 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-21bbeb98-22d2-47e7-a289-366a90950728" returned: 0 in 0.403s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-quobyte-21bbeb98-22d2-47e7-a289-366a90950728" released by "delete_volume" :: held 0.900s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Created reservations ['1d4ed857-9694-4b03-8b1c-d90884d46ffa', '69cdae60-78e0-4574-989d-a6f9cf79f6fe', '91643dac-3f88-44a1-af29-2027fa33918a', 'c33431ca-a626-48f8-b1ff-920636e029e4'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:00 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d 1G" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:00 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d Apr 17 16:28:00 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:00 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:00 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Flow 'volume_create_manager' (7ddfcfe3-2885-4722-b968-f790642742e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b914749-a69d-43dd-bad6-a212411915f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b914749-a69d-43dd-bad6-a212411915f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e9ac19-2749-4c84-8ae9-567f527542c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f5d24c2d24d9cb6c4597fee18d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9eb4b8af-f0af-402d-827b-3d61982868f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:01Z,use_quota=True,user_id='c9ee0b1058734455a6478e557530eb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca5776e-5dca-4122-85a1-6fd23ca001ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca5776e-5dca-4122-85a1-6fd23ca001ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af57c968-8981-47b1-bdc4-a5f87c005c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af57c968-8981-47b1-bdc4-a5f87c005c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01e9ac19-2749-4c84-8ae9-567f527542c4', 'volume_name': 'volume-01e9ac19-2749-4c84-8ae9-567f527542c4', 'volume_size': 1, 'snapshot_id': '9eb4b8af-f0af-402d-827b-3d61982868f1'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2fd8dd-8390-4d1d-931f-55eba332b097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2fd8dd-8390-4d1d-931f-55eba332b097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c099f2c-4a72-4584-a3ac-4758295d8c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:00 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Volume 01e9ac19-2749-4c84-8ae9-567f527542c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01e9ac19-2749-4c84-8ae9-567f527542c4', 'volume_size': 1, 'snapshot_id': '9eb4b8af-f0af-402d-827b-3d61982868f1'} Apr 17 16:28:00 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:01 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" returned: 0 in 0.467s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:01 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d is being set with open permissions: ugo+rw Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:01 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d Apr 17 16:28:01 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:01 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.467s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:01 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Deleted volume successfully. Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-03123bc2-d542-4c4a-acaf-ea1c87eb8543 tempest-CreateVolumesFromSourceVolumeTest-1381811847 None] Lock "cinder-21bbeb98-22d2-47e7-a289-366a90950728-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:01 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" returned: 0 in 0.405s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:01 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.info Apr 17 16:28:01 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:01 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.info" returned: 0 in 0.412s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:01 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.info is being set with open permissions: ugo+rw Apr 17 16:28:01 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:01 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.info Apr 17 16:28:01 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:02 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.info" returned: 0 in 0.499s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.892s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-371603926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa78a13d-0b66-41b3-a97b-577449dfcc46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78cfdeccc6545b1b92ea84446abad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:00Z,use_quota=True,user_id='71eeb999752f47ce93b8e8fbf9705347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Creating volume aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:02 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:02 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 1073741824 Apr 17 16:28:02 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:02 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a72e764a-b3f5-412e-809b-090507968480 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Create snapshot completed successfully Apr 17 16:28:02 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 1073741824" returned: 0 in 0.514s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:02 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:02 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 Apr 17 16:28:02 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (1db45459-02ac-41f8-a3e6-f4c055a96959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b74467-4a05-47e7-ac1c-528bdcc2a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b74467-4a05-47e7-ac1c-528bdcc2a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767982855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966cdf04-ea6e-4e17-bbbe-cc324ef79442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:03Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9569e5-88fe-477e-933f-adbe0ac0d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9569e5-88fe-477e-933f-adbe0ac0d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e69d7e-2818-4930-b907-4d503d6d86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e69d7e-2818-4930-b907-4d503d6d86d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966cdf04-ea6e-4e17-bbbe-cc324ef79442', 'volume_name': 'volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8d5261-b0c8-4d94-b918-e234e051733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8d5261-b0c8-4d94-b918-e234e051733c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732fc3e0-6314-45ef-b858-498ffdf6bf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume 966cdf04-ea6e-4e17-bbbe-cc324ef79442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442', 'volume_size': 1} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:03 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Flow 'volume_create_manager' (d5f3ba0b-d973-44c7-8e77-ab2ff6d8b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1ce3cd-cece-42d7-9221-57823f759651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1ce3cd-cece-42d7-9221-57823f759651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca150ee-bb51-4227-b6e1-88d1bf708b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb65a195512d402b8f140b5a24421ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:03Z,use_quota=True,user_id='26ae7c73d59d4063a68acab54dd9e694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebdc1a5-1180-4db6-82de-023aa9276bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebdc1a5-1180-4db6-82de-023aa9276bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727e473b-b3e3-44ee-896f-d8b89847f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727e473b-b3e3-44ee-896f-d8b89847f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca150ee-bb51-4227-b6e1-88d1bf708b95', 'volume_name': 'volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9dc766-468b-490a-bbf0-a0e0226f6e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9dc766-468b-490a-bbf0-a0e0226f6e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451c232f-10c3-469e-bf9e-8c808e3cb9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Volume 6ca150ee-bb51-4227-b6e1-88d1bf708b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95', 'volume_size': 1} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46" returned: 0 in 0.633s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.588s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-quobyte-9eb4b8af-f0af-402d-827b-3d61982868f1-01e9ac19-2749-4c84-8ae9-567f527542c4" by "_create_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf591f33-6a4f-46e7-8342-2631f71314de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa78a13d-0b66-41b3-a97b-577449dfcc46', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fbaa24-3b74-466a-aa40-4aee9469c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (f5200795-0824-46fd-810a-48aa29ecddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7565be68-beca-45ed-bbaa-b3999bd459e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-9eb4b8af-f0af-402d-827b-3d61982868f1-01e9ac19-2749-4c84-8ae9-567f527542c4" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Creating volume 01e9ac19-2749-4c84-8ae9-567f527542c4 from snapshot 9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-quobyte-01e9ac19-2749-4c84-8ae9-567f527542c4" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Volume volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 (aa78a13d-0b66-41b3-a97b-577449dfcc46): created successfully Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fbaa24-3b74-466a-aa40-4aee9469c580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (9db47f7f-8179-4a46-b56e-f56a33a00c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-01e9ac19-2749-4c84-8ae9-567f527542c4" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] snapshot: 9eb4b8af-f0af-402d-827b-3d61982868f1, volume: 01e9ac19-2749-4c84-8ae9-567f527542c4, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7565be68-beca-45ed-bbaa-b3999bd459e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582157231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d816e4d4-a1cd-4cff-a50a-130b7d1f6aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75aa3918-0f49-4b1c-ae03-259890844395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75aa3918-0f49-4b1c-ae03-259890844395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d24f86-fb41-4cfc-8bd4-646c11151217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d24f86-fb41-4cfc-8bd4-646c11151217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd816e4d4-a1cd-4cff-a50a-130b7d1f6aca', 'volume_name': 'volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73877652-5518-418e-b71a-46ecc15dca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73877652-5518-418e-b71a-46ecc15dca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097771e4-3031-4220-be01-a37efae4a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume d816e4d4-a1cd-4cff-a50a-130b7d1f6aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca', 'volume_size': 1} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:03 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-0eca5f29-3133-4c85-9bb8-a548a9d00e61 tempest-VolumeDependencyTests-963862766 None] Created volume successfully. Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5014276d-ad86-48fb-b8c1-bfe433a45a2a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (00213628-1a68-4c90-b00a-abf33dc22f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544901e3-bd44-4918-bed0-62e27333c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544901e3-bd44-4918-bed0-62e27333c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699317254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3e3ea1-ebd7-481a-81d2-3458a9db704c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481d823c-0387-422e-b860-1b203933f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481d823c-0387-422e-b860-1b203933f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f88e47d-d24f-4801-ad3c-f956c9f89d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f88e47d-d24f-4801-ad3c-f956c9f89d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3e3ea1-ebd7-481a-81d2-3458a9db704c', 'volume_name': 'volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050df364-8f18-40ea-8ba8-824142818349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050df364-8f18-40ea-8ba8-824142818349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f780db-0a24-459d-b2c2-73baffd887b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume 4b3e3ea1-ebd7-481a-81d2-3458a9db704c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c', 'volume_size': 1} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:03 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 Apr 17 16:28:03 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (98d90ebd-6ed8-4e59-8dc3-1ae7ab986d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2926706f-69fe-491d-938f-1ad266a36f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2926706f-69fe-491d-938f-1ad266a36f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162608236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1080730e-5e92-4fd5-9169-a8034920e0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb0b2b9-63ce-4d6a-aa72-47b32abab19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb0b2b9-63ce-4d6a-aa72-47b32abab19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:03 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee21d12-e1f5-4588-add2-0c3a97e2eb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee21d12-e1f5-4588-add2-0c3a97e2eb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1080730e-5e92-4fd5-9169-a8034920e0f9', 'volume_name': 'volume-1080730e-5e92-4fd5-9169-a8034920e0f9', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e662c2d-88b4-455d-8fa8-9e88bdafe2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e662c2d-88b4-455d-8fa8-9e88bdafe2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809c2b7c-f782-448c-9b3f-cf477c7b8ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume 1080730e-5e92-4fd5-9169-a8034920e0f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1080730e-5e92-4fd5-9169-a8034920e0f9', 'volume_size': 1} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (01ce9635-7902-4119-a241-558db2da8fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4243d994-f939-4a06-8b2b-8c23a51da20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4243d994-f939-4a06-8b2b-8c23a51da20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1651859468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3cfcef-fc07-4594-841d-7af11e310bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af2a3b0-d18b-41a2-bd86-f46fc7182579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af2a3b0-d18b-41a2-bd86-f46fc7182579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407ea631-c06c-45b1-b00e-b5655b8178fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407ea631-c06c-45b1-b00e-b5655b8178fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3cfcef-fc07-4594-841d-7af11e310bff', 'volume_name': 'volume-db3cfcef-fc07-4594-841d-7af11e310bff', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf5372b-ebc2-444c-81e7-3917845cca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf5372b-ebc2-444c-81e7-3917845cca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727f95f1-f67b-4246-986e-557fb8b5cc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume db3cfcef-fc07-4594-841d-7af11e310bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3cfcef-fc07-4594-841d-7af11e310bff', 'volume_size': 1} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:04 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1" returned: 0 in 0.570s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07ea2504-fd90-4885-8adb-511886cb2423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[af02dea2-398b-427a-8fbb-68fcb85fe78d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:04 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 Apr 17 16:28:04 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (955820e4-b009-40b7-b77a-3643bfa15fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2a914b-1177-447b-82dd-9fadb5045b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2a914b-1177-447b-82dd-9fadb5045b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1516782829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4291fb43-9a01-4cef-a787-075b3d203957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78cfdeccc6545b1b92ea84446abad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=aa78a13d-0b66-41b3-a97b-577449dfcc46,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:05Z,use_quota=True,user_id='71eeb999752f47ce93b8e8fbf9705347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4326d7ae-e5d2-4598-85a3-3413debd8429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4326d7ae-e5d2-4598-85a3-3413debd8429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6d2aa7-1b4b-4093-a039-e21be9bf89a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6d2aa7-1b4b-4093-a039-e21be9bf89a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4291fb43-9a01-4cef-a787-075b3d203957', 'volume_name': 'volume-4291fb43-9a01-4cef-a787-075b3d203957', 'volume_size': 1, 'source_volid': 'aa78a13d-0b66-41b3-a97b-577449dfcc46', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8643b8-f83e-4090-bd02-a07c86784466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8643b8-f83e-4090-bd02-a07c86784466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee4ad04-a5f1-4afb-85d9-b80fc2ce2b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:04 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Volume 4291fb43-9a01-4cef-a787-075b3d203957: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4291fb43-9a01-4cef-a787-075b3d203957', 'volume_size': 1, 'source_volid': 'aa78a13d-0b66-41b3-a97b-577449dfcc46', 'source_volstatus': 'available'} Apr 17 16:28:04 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423" returned: 0 in 0.532s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:04 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:04 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 Apr 17 16:28:04 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:06 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4" returned: 0 in 2.086s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:06 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56b45df-c1b1-41fc-ac65-7280723d8504]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:06 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:06 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 Apr 17 16:28:06 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:07 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423" returned: 0 in 0.572s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:28:07 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Converted 1024.00 MB image at 490.64 MB/s Apr 17 16:28:07 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 is being set with open permissions: ugo+rw Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:07 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 Apr 17 16:28:07 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:07 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4" returned: 0 in 0.428s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-01e9ac19-2749-4c84-8ae9-567f527542c4" released by "_copy_volume_from_snapshot" :: held 4.286s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-9eb4b8af-f0af-402d-827b-3d61982868f1-01e9ac19-2749-4c84-8ae9-567f527542c4" released by "_create_volume_from_snapshot" :: held 4.319s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.368s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.522s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767982855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966cdf04-ea6e-4e17-bbbe-cc324ef79442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:03Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Creating volume 966cdf04-ea6e-4e17-bbbe-cc324ef79442 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:07 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:07 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 1073741824 Apr 17 16:28:07 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c099f2c-4a72-4584-a3ac-4758295d8c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e9ac19-2749-4c84-8ae9-567f527542c4', 'volume_size': 1, 'snapshot_id': '9eb4b8af-f0af-402d-827b-3d61982868f1'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:07 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac320a2-448a-4993-984d-ce856d22236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:07 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Volume volume-01e9ac19-2749-4c84-8ae9-567f527542c4 (01e9ac19-2749-4c84-8ae9-567f527542c4): created successfully Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac320a2-448a-4993-984d-ce856d22236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Flow 'volume_create_manager' (7ddfcfe3-2885-4722-b968-f790642742e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:08 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-cd164c23-25d9-43b0-bb49-e092e4883b89 tempest-SnapshotDependencyTests-410761406 None] Created volume successfully. Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-9eb4b8af-f0af-402d-827b-3d61982868f1-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-9eb4b8af-f0af-402d-827b-3d61982868f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-quobyte-07ea2504-fd90-4885-8adb-511886cb2423" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-07ea2504-fd90-4885-8adb-511886cb2423" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-quobyte-9eb4b8af-f0af-402d-827b-3d61982868f1" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-9eb4b8af-f0af-402d-827b-3d61982868f1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Deleting offline snapshot 9eb4b8af-f0af-402d-827b-3d61982868f1 of volume 07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] snapshot_file for this snap is: volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898702f-fc3c-4e4c-ac89-c6802c0fd75f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:08 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 Apr 17 16:28:08 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:08 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 1073741824" returned: 0 in 0.518s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:08 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 Apr 17 16:28:08 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:08 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1" returned: 0 in 0.517s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07ea2504-fd90-4885-8adb-511886cb2423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4f2ba8-4e4b-4c15-bc87-d66ee0dcc835]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:08 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442" returned: 0 in 0.432s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.379s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca150ee-bb51-4227-b6e1-88d1bf708b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb65a195512d402b8f140b5a24421ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:03Z,use_quota=True,user_id='26ae7c73d59d4063a68acab54dd9e694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Creating volume 6ca150ee-bb51-4227-b6e1-88d1bf708b95 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:08 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:08 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 Apr 17 16:28:08 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732fc3e0-6314-45ef-b858-498ffdf6bf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc5b555-fb78-441c-9344-54daaf83620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:08 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 1073741824 Apr 17 16:28:08 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:08 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 (966cdf04-ea6e-4e17-bbbe-cc324ef79442): created successfully Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc5b555-fb78-441c-9344-54daaf83620c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:08 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (1db45459-02ac-41f8-a3e6-f4c055a96959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:08 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-43327d29-4842-49eb-8988-9b22a5e906c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created volume successfully. Apr 17 16:28:09 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423" returned: 0 in 0.505s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:09 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 Apr 17 16:28:09 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:09 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 1073741824" returned: 0 in 0.563s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:09 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 Apr 17 16:28:09 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:09 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1" returned: 0 in 0.461s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:09 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1 Apr 17 16:28:09 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:09 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95" returned: 0 in 0.431s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.269s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582157231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d816e4d4-a1cd-4cff-a50a-130b7d1f6aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Creating volume d816e4d4-a1cd-4cff-a50a-130b7d1f6aca {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:09 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451c232f-10c3-469e-bf9e-8c808e3cb9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:09 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2e05b4-d04c-45d2-9a99-e36998eb00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:09 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca 1073741824 Apr 17 16:28:09 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:10 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Volume volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 (6ca150ee-bb51-4227-b6e1-88d1bf708b95): created successfully Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2e05b4-d04c-45d2-9a99-e36998eb00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Flow 'volume_create_manager' (d5f3ba0b-d973-44c7-8e77-ab2ff6d8b57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:10 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-829571da-cbc3-48fb-8a33-10b661fd5e11 tempest-CinderUnicodeTest-1066328607 None] Created volume successfully. Apr 17 16:28:10 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423.9eb4b8af-f0af-402d-827b-3d61982868f1" returned: 0 in 0.428s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-9eb4b8af-f0af-402d-827b-3d61982868f1" released by "_delete_snapshot" :: held 1.961s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-07ea2504-fd90-4885-8adb-511886cb2423" released by "delete_snapshot" :: held 1.974s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Created reservations ['bd5b8530-4342-4262-bc0b-2a2dc2d0f136', '1bf031ee-83f2-4db6-892f-c54a3babce2a', '582e0fdd-d9c8-4d51-9e05-628e48ad9718', '37982612-56fa-4968-8ad6-d69d43173883'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:10 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Delete snapshot completed successfully. Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e1a7441a-5ea8-48fc-81ba-2685337cc099 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-9eb4b8af-f0af-402d-827b-3d61982868f1-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-07ea2504-fd90-4885-8adb-511886cb2423-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-07ea2504-fd90-4885-8adb-511886cb2423-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-quobyte-07ea2504-fd90-4885-8adb-511886cb2423" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-07ea2504-fd90-4885-8adb-511886cb2423" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40796f3-2d2f-402c-8624-5fccd0199c06]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:10 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca 1073741824" returned: 0 in 0.585s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:10 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:10 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 Apr 17 16:28:10 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:10 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca Apr 17 16:28:10 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:28:11 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:11 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Flow 'volume_create_manager' (3ac3d75a-ab98-4971-bfc2-ece16cf8b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92799c1-ba11-463f-851c-6c8ae8c9adc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca" returned: 0 in 0.531s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423" returned: 0 in 0.598s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.293s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699317254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3e3ea1-ebd7-481a-81d2-3458a9db704c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Creating volume 4b3e3ea1-ebd7-481a-81d2-3458a9db704c {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:11 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:11 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423 Apr 17 16:28:11 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92799c1-ba11-463f-851c-6c8ae8c9adc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-133045419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3c4db3-fa1c-446f-b6ff-98dac6e90e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb65a195512d402b8f140b5a24421ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:11Z,use_quota=True,user_id='26ae7c73d59d4063a68acab54dd9e694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:11 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c 1073741824 Apr 17 16:28:11 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0009b3-c3e3-4e54-a07d-cb1d0afb1eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0009b3-c3e3-4e54-a07d-cb1d0afb1eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229f859a-01e4-453b-ae4a-5f72d2733a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229f859a-01e4-453b-ae4a-5f72d2733a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3c4db3-fa1c-446f-b6ff-98dac6e90e10', 'volume_name': 'volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fc4039-600c-40fb-ae10-2cc1d2eb6cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fc4039-600c-40fb-ae10-2cc1d2eb6cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca7cd15-5300-4ad5-955c-ed47b5ee8d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:11 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Volume 6d3c4db3-fa1c-446f-b6ff-98dac6e90e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10', 'volume_size': 1} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097771e4-3031-4220-be01-a37efae4a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2349698a-e08d-4a21-9e41-6cd000188779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:11 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca (d816e4d4-a1cd-4cff-a50a-130b7d1f6aca): created successfully Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2349698a-e08d-4a21-9e41-6cd000188779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (f5200795-0824-46fd-810a-48aa29ecddf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:11 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-568d4cd5-0eeb-4b2d-918c-4088e9f8c5c0 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created volume successfully. Apr 17 16:28:11 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-07ea2504-fd90-4885-8adb-511886cb2423" returned: 0 in 0.412s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-07ea2504-fd90-4885-8adb-511886cb2423" released by "delete_volume" :: held 1.052s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Created reservations ['0ec970dc-180e-4817-8902-bbf2f35e1489', '1ccbe3a9-082e-48fd-a59f-c9ae6ec827ba', '8e896d6a-bc6f-467e-8c03-b103af7d36c8', '28766e84-1f97-4e0c-abf3-8f2ec601a6bf'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:11 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:11 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:11 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c 1073741824" returned: 0 in 0.554s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:11 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:11 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c Apr 17 16:28:11 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:12 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.429s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:12 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Deleted volume successfully. Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-aa09c242-5580-4162-a037-d65383d66f57 tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-07ea2504-fd90-4885-8adb-511886cb2423-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:12 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c" returned: 0 in 0.441s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.140s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162608236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1080730e-5e92-4fd5-9169-a8034920e0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Creating volume 1080730e-5e92-4fd5-9169-a8034920e0f9 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:12 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f780db-0a24-459d-b2c2-73baffd887b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:12 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 1073741824 Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c746405f-9265-42ff-b1e5-5f9397933ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:12 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:12 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c (4b3e3ea1-ebd7-481a-81d2-3458a9db704c): created successfully Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c746405f-9265-42ff-b1e5-5f9397933ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (00213628-1a68-4c90-b00a-abf33dc22f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:12 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5835aabb-3d10-42f3-ae38-ccf6569847fb tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created volume successfully. Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-01e9ac19-2749-4c84-8ae9-567f527542c4-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-01e9ac19-2749-4c84-8ae9-567f527542c4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:12 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 1073741824" returned: 0 in 0.518s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "cinder-quobyte-01e9ac19-2749-4c84-8ae9-567f527542c4" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-01e9ac19-2749-4c84-8ae9-567f527542c4" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:12 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 Apr 17 16:28:12 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc31e5b-9b7b-43b5-9341-37123799c411]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:12 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:12 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 Apr 17 16:28:12 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:13 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9" returned: 0 in 0.427s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.923s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1651859468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3cfcef-fc07-4594-841d-7af11e310bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badab9d38894bc59cf9259d7641abe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:04Z,use_quota=True,user_id='c2f0abbb6ef445969efe16d02047aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Creating volume db3cfcef-fc07-4594-841d-7af11e310bff {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:13 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809c2b7c-f782-448c-9b3f-cf477c7b8ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1080730e-5e92-4fd5-9169-a8034920e0f9', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69389fce-9cee-41be-91b4-9c639284e61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:13 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff 1073741824 Apr 17 16:28:13 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:13 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume volume-1080730e-5e92-4fd5-9169-a8034920e0f9 (1080730e-5e92-4fd5-9169-a8034920e0f9): created successfully Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69389fce-9cee-41be-91b4-9c639284e61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (98d90ebd-6ed8-4e59-8dc3-1ae7ab986d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:13 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-be56f49a-22df-4eed-9e1f-90c8c551cb29 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created volume successfully. Apr 17 16:28:13 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4" returned: 0 in 0.496s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:13 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4 Apr 17 16:28:13 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:13 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff 1073741824" returned: 0 in 0.503s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:13 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-01e9ac19-2749-4c84-8ae9-567f527542c4" returned: 0 in 0.461s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:13 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff Apr 17 16:28:13 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-quobyte-01e9ac19-2749-4c84-8ae9-567f527542c4" released by "delete_volume" :: held 0.983s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Created reservations ['ba512e36-0cd0-4cfa-95e5-cfead75ce5ed', 'a306ead5-de54-4331-b0c7-fcdd7cef3c66', 'b96cf35c-b02c-4920-bd7b-e080bd23d550', 'c10f918c-3889-435a-b06e-2856267eb7c9'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:13 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:13 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:13 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:14 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.315s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:14 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Cloning volume aa78a13d-0b66-41b3-a97b-577449dfcc46 to volume 4291fb43-9a01-4cef-a787-075b3d203957 Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727f95f1-f67b-4246-986e-557fb8b5cc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3cfcef-fc07-4594-841d-7af11e310bff', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181b3c4f-9a91-490c-b8e8-f1b8c7180ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:14 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Volume volume-db3cfcef-fc07-4594-841d-7af11e310bff (db3cfcef-fc07-4594-841d-7af11e310bff): created successfully Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181b3c4f-9a91-490c-b8e8-f1b8c7180ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Flow 'volume_create_manager' (01ce9635-7902-4119-a241-558db2da8fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Creating offline snapshot 2802c9e1-7355-4d2b-97a7-1c830b946b8e of volume aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:28:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-b02786ee-0a69-45b3-9eae-00140161f8a6 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created volume successfully. Apr 17 16:28:14 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.463s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1203c383-3abf-4791-8c16-2f0aabff5745]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:14 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Deleted volume successfully. Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-14be6df6-4754-4f5b-b964-052126f60a1c tempest-SnapshotDependencyTests-410761406 None] Lock "cinder-01e9ac19-2749-4c84-8ae9-567f527542c4-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:14 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 Apr 17 16:28:14 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:14 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46" returned: 0 in 0.548s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:14 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e 1G Apr 17 16:28:14 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-db3cfcef-fc07-4594-841d-7af11e310bff-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:14 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-db3cfcef-fc07-4594-841d-7af11e310bff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-db3cfcef-fc07-4594-841d-7af11e310bff" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-db3cfcef-fc07-4594-841d-7af11e310bff" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6075b4-28fb-4594-b687-7d648296b0af]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:15 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff Apr 17 16:28:15 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:15 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e 1G" returned: 0 in 0.583s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:15 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e Apr 17 16:28:15 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:15 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff" returned: 0 in 0.560s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:15 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff Apr 17 16:28:15 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:15 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e" returned: 0 in 0.477s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:15 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e is being set with open permissions: ugo+rw Apr 17 16:28:15 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:15 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e Apr 17 16:28:15 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:16 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-db3cfcef-fc07-4594-841d-7af11e310bff" returned: 0 in 0.419s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-db3cfcef-fc07-4594-841d-7af11e310bff" released by "delete_volume" :: held 1.015s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created reservations ['7327c1da-46bc-49b7-8140-949925410248', '53bb1877-142d-472f-a211-e280f2d0fa9a', 'f5200295-5f50-4eff-8bcb-c471d332f8e1', '9afdacd5-9549-4074-832d-17ca3e89a967'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:16 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:16 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:16 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e" returned: 0 in 0.468s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:16 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.info Apr 17 16:28:16 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:16 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.450s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:16 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Deleted volume successfully. Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-2e68407d-c534-4453-97f4-c5526c953ade tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-db3cfcef-fc07-4594-841d-7af11e310bff-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:16 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.info" returned: 0 in 0.502s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:16 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.info is being set with open permissions: ugo+rw Apr 17 16:28:16 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:16 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.info Apr 17 16:28:16 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-1080730e-5e92-4fd5-9169-a8034920e0f9-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-1080730e-5e92-4fd5-9169-a8034920e0f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-1080730e-5e92-4fd5-9169-a8034920e0f9" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-1080730e-5e92-4fd5-9169-a8034920e0f9" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[689920d2-b449-4a46-a0ae-1232fea8648b]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:17 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 Apr 17 16:28:17 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:17 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.info" returned: 0 in 0.479s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-4291fb43-9a01-4cef-a787-075b3d203957" by "_copy_volume_from_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-4291fb43-9a01-4cef-a787-075b3d203957" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] snapshot: 2802c9e1-7355-4d2b-97a7-1c830b946b8e, volume: 4291fb43-9a01-4cef-a787-075b3d203957, {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac4a249-c855-416f-9236-5d8b037afd2c]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:17 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e Apr 17 16:28:17 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:17 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9" returned: 0 in 0.541s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:17 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9 Apr 17 16:28:17 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:17 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e" returned: 0 in 0.546s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa78a13d-0b66-41b3-a97b-577449dfcc46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Creating direct copy from snapshot {{(pid=82061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d03cad-8d8d-4898-82e1-e344d6463bb8]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:17 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:17 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 Apr 17 16:28:18 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:18 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-1080730e-5e92-4fd5-9169-a8034920e0f9" returned: 0 in 0.424s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-1080730e-5e92-4fd5-9169-a8034920e0f9" released by "delete_volume" :: held 0.987s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created reservations ['61c67b25-4b25-4d0b-bd67-fd0beceb49cf', 'f82bab3b-e28b-4b9f-906f-276b73ea6c57', '7afd46fd-40f4-4042-a976-f747facc81d3', '32762ae2-f348-4500-bd13-eacfb3b7a00a'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:18 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:18 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-4b3e3ea1-ebd7-481a-81d2-3458a9db704c-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-4b3e3ea1-ebd7-481a-81d2-3458a9db704c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-4b3e3ea1-ebd7-481a-81d2-3458a9db704c" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-4b3e3ea1-ebd7-481a-81d2-3458a9db704c" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e22c811-6487-4770-82d7-0a34fe6c6d46]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:18 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c Apr 17 16:28:18 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:18 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46" returned: 0 in 0.650s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.utils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Path /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 not found in is_blk_device check {{(pid=82061) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:18 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 Apr 17 16:28:18 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:18 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.524s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:18 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Deleted volume successfully. Apr 17 16:28:18 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-11dc8ae2-e17a-435e-8d2a-35d6568334b4 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-1080730e-5e92-4fd5-9169-a8034920e0f9-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:19 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c" returned: 0 in 0.557s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:19 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:19 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c Apr 17 16:28:19 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:20 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4b3e3ea1-ebd7-481a-81d2-3458a9db704c" returned: 0 in 1.417s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-4b3e3ea1-ebd7-481a-81d2-3458a9db704c" released by "delete_volume" :: held 2.003s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created reservations ['7bac8dcf-a5cd-4463-a891-b057f72400f6', '6efdea3d-72d5-436e-b70b-469673a0b418', '65c633c9-dc53-4b28-8557-4c20fa51fa82', 'db51f8d4-f71b-478c-9776-0214fd4b4a1d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:20 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:20 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:20 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca" acquired by "delete_volume" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab381cd-88b7-474d-8498-c958befb8b8f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:21 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957" returned: 0 in 2.458s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19cd0a5-1d69-4378-9dc2-fbfcd5ef6b7a]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:21 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca Apr 17 16:28:21 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:21 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 Apr 17 16:28:21 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:21 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.702s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:21 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Deleted volume successfully. Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf5b34e4-a7eb-4578-afa1-0c704c803cb9 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-4b3e3ea1-ebd7-481a-81d2-3458a9db704c-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:21 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca" returned: 0 in 0.585s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:21 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca Apr 17 16:28:21 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:21 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46" returned: 0 in 0.675s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG cinder.image.image_utils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Image conversion details: src /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 {{(pid=82061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:28:21 devstack cinder-volume[82061]: INFO cinder.image.image_utils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Converted 1024.00 MB image at 416.22 MB/s Apr 17 16:28:21 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 is being set with open permissions: ugo+rw Apr 17 16:28:21 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:21 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 Apr 17 16:28:21 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:22 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca" released by "delete_volume" :: held 1.094s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created reservations ['525c1888-e160-4bcb-b68a-af655f3ade6b', '4ca99229-7fcb-4e9a-a5ae-770852076822', '506934f8-de34-4162-a2d5-6bbc3789dd26', '0cd5ed9f-6350-4b98-ab75-3717f974ca45'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:22 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:22 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:22 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957" returned: 0 in 0.497s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-4291fb43-9a01-4cef-a787-075b3d203957" released by "_copy_volume_from_snapshot" :: held 4.877s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-2802c9e1-7355-4d2b-97a7-1c830b946b8e" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-2802c9e1-7355-4d2b-97a7-1c830b946b8e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Deleting offline snapshot 2802c9e1-7355-4d2b-97a7-1c830b946b8e of volume aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] snapshot_file for this snap is: volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f05d9-293a-43b6-b5cd-a9a5e7313b91]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:22 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e Apr 17 16:28:22 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:22 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.450s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:22 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Deleted volume successfully. Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-bfc8bf02-5fe9-4c40-a123-2dba2e4d8370 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-d816e4d4-a1cd-4cff-a50a-130b7d1f6aca-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:22 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e" returned: 0 in 0.489s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa78a13d-0b66-41b3-a97b-577449dfcc46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb4863e-56f1-4126-bdf5-369fe8154f76]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:22 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:22 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 Apr 17 16:28:22 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-966cdf04-ea6e-4e17-bbbe-cc324ef79442-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-966cdf04-ea6e-4e17-bbbe-cc324ef79442-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-966cdf04-ea6e-4e17-bbbe-cc324ef79442" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-966cdf04-ea6e-4e17-bbbe-cc324ef79442" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2328e-b213-4afa-aea8-f99a517b244f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:23 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 Apr 17 16:28:23 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:23 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46" returned: 0 in 0.510s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:23 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e Apr 17 16:28:23 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:23 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:23 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442 Apr 17 16:28:23 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:23 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:23 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:23 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e Apr 17 16:28:23 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:24 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-966cdf04-ea6e-4e17-bbbe-cc324ef79442" returned: 0 in 0.444s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-966cdf04-ea6e-4e17-bbbe-cc324ef79442" released by "delete_volume" :: held 0.959s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created reservations ['a3bc5069-7557-4cd2-988e-9f1c73232862', 'd6f2b704-2df1-42f9-92da-21e86ebfe0a4', '0aef624e-c5fd-44ff-a651-5d9f36e2b015', '00b0f055-de99-4519-8c55-4c22f4f10b28'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:24 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:24 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-ddd3c479-d654-4d8a-a83b-e4f5723f5e3d-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:24 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46.2802c9e1-7355-4d2b-97a7-1c830b946b8e" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-2802c9e1-7355-4d2b-97a7-1c830b946b8e" released by "_delete_snapshot" :: held 2.024s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-ddd3c479-d654-4d8a-a83b-e4f5723f5e3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-337f7e04-2567-4eea-8780-7be7b2bdb2bc" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-337f7e04-2567-4eea-8780-7be7b2bdb2bc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Deleting offline snapshot ddd3c479-d654-4d8a-a83b-e4f5723f5e3d of volume 337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] snapshot_file for this snap is: volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.160s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.152s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:28:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-133045419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3c4db3-fa1c-446f-b6ff-98dac6e90e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb65a195512d402b8f140b5a24421ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:28:11Z,use_quota=True,user_id='26ae7c73d59d4063a68acab54dd9e694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1291ca5a-61ea-467b-aa41-9d131c0cc58c),volume_type_id=1291ca5a-61ea-467b-aa41-9d131c0cc58c)}" {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Creating volume 6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Selected osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 as target Quobyte volume. {{(pid=82061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:28:24 devstack cinder-volume[82061]: INFO cinder.volume.drivers.remotefs [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] casted to osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4 Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 1073741824 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5067ff-d4ee-462d-ba59-72332e8fc952]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:24 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 1073741824 Apr 17 16:28:24 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee4ad04-a5f1-4afb-85d9-b80fc2ce2b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4291fb43-9a01-4cef-a787-075b3d203957', 'volume_size': 1, 'source_volid': 'aa78a13d-0b66-41b3-a97b-577449dfcc46', 'source_volstatus': 'available'}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87979208-b795-4944-be0c-1159c687c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:24 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Volume volume-4291fb43-9a01-4cef-a787-075b3d203957 (4291fb43-9a01-4cef-a787-075b3d203957): created successfully Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87979208-b795-4944-be0c-1159c687c087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Flow 'volume_create_manager' (955820e4-b009-40b7-b77a-3643bfa15fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:24 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5db01914-bd4f-464e-b3b0-c4e88d272093 tempest-VolumeDependencyTests-963862766 None] Created volume successfully. Apr 17 16:28:24 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d Apr 17 16:28:24 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:24 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.439s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:24 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Deleted volume successfully. Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-36cb1273-1189-4a99-a497-c4c0b4a2f045 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-966cdf04-ea6e-4e17-bbbe-cc324ef79442-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:24 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" returned: 0 in 0.545s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f57c8-9f1a-4dd8-922d-f6e48baa62a0]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:24 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 1073741824" returned: 0 in 0.583s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:24 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:24 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 Apr 17 16:28:24 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:24 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc Apr 17 16:28:24 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-aa78a13d-0b66-41b3-a97b-577449dfcc46-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-aa78a13d-0b66-41b3-a97b-577449dfcc46-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-aa78a13d-0b66-41b3-a97b-577449dfcc46" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-aa78a13d-0b66-41b3-a97b-577449dfcc46" acquired by "delete_volume" :: waited 0.013s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8bba1b-686c-4aac-9dad-000d9e38be79]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:25 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 Apr 17 16:28:25 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:25 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" returned: 0 in 0.460s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'} {{(pid=82061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca7cd15-5300-4ad5-955c-ed47b5ee8d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10', 'volume_size': 1}' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ea98e8-d0ef-4b1c-a6ec-07158945cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:28:25 devstack cinder-volume[82061]: INFO cinder.volume.flows.manager.create_volume [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Volume volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 (6d3c4db3-fa1c-446f-b6ff-98dac6e90e10): created successfully Apr 17 16:28:25 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ea98e8-d0ef-4b1c-a6ec-07158945cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82061) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Flow 'volume_create_manager' (3ac3d75a-ab98-4971-bfc2-ece16cf8b537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82061) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc" returned: 0 in 0.533s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:25 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-8792d37e-c902-484f-850d-b6076d4658f6 tempest-CinderUnicodeTest-1066328607 None] Created volume successfully. Apr 17 16:28:25 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d Apr 17 16:28:25 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:25 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46" returned: 0 in 0.498s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:25 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46 Apr 17 16:28:25 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:25 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:25 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:25 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d Apr 17 16:28:25 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:26 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-aa78a13d-0b66-41b3-a97b-577449dfcc46" returned: 0 in 0.485s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Creating offline snapshot 26ff329c-5898-4fdc-bff8-340e082017dc of volume 6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-aa78a13d-0b66-41b3-a97b-577449dfcc46" released by "delete_volume" :: held 1.029s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e633e633-7209-4725-b7b9-3b0e3650d73d]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Created reservations ['33abb833-cec6-4c09-9094-577292cf1403', '3c19f661-58d1-4c62-82bd-97a679d31358', 'b83aa860-6107-4694-a1dc-e7ab6775abd8', 'e1476283-733d-48bc-8519-fc6dfbe22a42'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:26 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:26 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 Apr 17 16:28:26 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc.ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" returned: 0 in 0.434s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-ddd3c479-d654-4d8a-a83b-e4f5723f5e3d" released by "_delete_snapshot" :: held 2.079s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-337f7e04-2567-4eea-8780-7be7b2bdb2bc" released by "delete_snapshot" :: held 2.101s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:26 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:26 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created reservations ['3b9344c4-2a28-43bc-bc4b-9859396138d8', '93df4656-e6c8-48c3-9090-0ad62730900c', '96af0328-8521-4ce5-8c2b-812433830879', '68898699-f90d-4bf6-88f5-966a16040520'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:26 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Delete snapshot completed successfully. Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-a24dc65f-654e-44ec-910a-05387a00bb1d tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-ddd3c479-d654-4d8a-a83b-e4f5723f5e3d-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:26 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" returned: 0 in 0.491s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc 1G {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:26 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc 1G Apr 17 16:28:26 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:26 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.422s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:26 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Deleted volume successfully. Apr 17 16:28:26 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-cf8b8ced-9c01-4cfb-9316-014b2097cc50 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-aa78a13d-0b66-41b3-a97b-577449dfcc46-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:27 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc 1G" returned: 0 in 0.471s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:27 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc Apr 17 16:28:27 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-4291fb43-9a01-4cef-a787-075b3d203957-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-337f7e04-2567-4eea-8780-7be7b2bdb2bc-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Lock "cinder-4291fb43-9a01-4cef-a787-075b3d203957-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-337f7e04-2567-4eea-8780-7be7b2bdb2bc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-4291fb43-9a01-4cef-a787-075b3d203957" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "cinder-quobyte-337f7e04-2567-4eea-8780-7be7b2bdb2bc" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-4291fb43-9a01-4cef-a787-075b3d203957" acquired by "delete_volume" :: waited 0.014s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-337f7e04-2567-4eea-8780-7be7b2bdb2bc" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0447c8-14bb-44e1-88ce-b81857306e86]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5996f264-6a9e-4518-a66e-12976a495317]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:27 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 Apr 17 16:28:27 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:27 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc Apr 17 16:28:27 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:27 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 -F qcow2 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc" returned: 0 in 0.481s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:27 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc is being set with open permissions: ugo+rw Apr 17 16:28:27 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:27 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc Apr 17 16:28:27 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:28 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:28 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc" returned: 0 in 0.486s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:28 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957 Apr 17 16:28:28 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:28 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc Apr 17 16:28:28 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:28 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc" returned: 0 in 0.413s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:28 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.info Apr 17 16:28:28 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:28 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-337f7e04-2567-4eea-8780-7be7b2bdb2bc" returned: 0 in 0.411s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:28 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-quobyte-337f7e04-2567-4eea-8780-7be7b2bdb2bc" released by "delete_volume" :: held 0.933s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-4291fb43-9a01-4cef-a787-075b3d203957" returned: 0 in 0.439s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-4291fb43-9a01-4cef-a787-075b3d203957" released by "delete_volume" :: held 0.956s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Created reservations ['b775f1d9-adcd-4063-8faf-28672cd9c552', '73657caa-ae87-427c-b2aa-f52a0c197d24', '5e526abf-f4d8-4818-b571-140defca8eae', '7f455691-64d4-45ce-bf4f-8e1ad5324289'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Created reservations ['935eca96-f410-4455-97d6-913fefba9f5c', 'd77f0243-0611-45be-9ae2-6396b192e117', '7d1015cb-6713-49ba-b24b-54f4b842d3e7', 'dbfa382b-3eea-41f4-9e1d-76b361b74cf0'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:28 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:28 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:28 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:28 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:28 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.info" returned: 0 in 0.466s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:28 devstack cinder-volume[82061]: WARNING cinder.volume.drivers.remotefs [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.info is being set with open permissions: ugo+rw Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.info {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:28 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.info Apr 17 16:28:28 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:28 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.427s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:28 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:29 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Deleted volume successfully. Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-85cfacb5-2e53-4e15-b3d1-1f78714dcf34 tempest-CreateVolumesFromSnapshotTest-1456243570 None] Lock "cinder-337f7e04-2567-4eea-8780-7be7b2bdb2bc-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:29 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.433s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:29 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:29 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Deleted volume successfully. Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.info" returned: 0 in 0.404s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.797s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-5ce879b7-0892-4556-8493-589e574503bf tempest-VolumeDependencyTests-963862766 None] Lock "cinder-4291fb43-9a01-4cef-a787-075b3d203957-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:29 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-ecc4fb4b-6b65-45d6-b015-eed97169a4c9 tempest-CinderUnicodeTest-1066328607 None] Create snapshot completed successfully Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "cinder-26ff329c-5898-4fdc-bff8-340e082017dc-delete_snapshot" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-26ff329c-5898-4fdc-bff8-340e082017dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "cinder-quobyte-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" by "delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "cinder-quobyte-26ff329c-5898-4fdc-bff8-340e082017dc" by "_delete_snapshot" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-26ff329c-5898-4fdc-bff8-340e082017dc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Deleting offline snapshot 26ff329c-5898-4fdc-bff8-340e082017dc of volume 6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] snapshot_file for this snap is: volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc {{(pid=82061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb839e8-d6a6-462c-b184-8c20f4c0ea9f]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:29 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc Apr 17 16:28:29 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-d461f085-4520-4d9f-81fb-88b742a2a261-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-d461f085-4520-4d9f-81fb-88b742a2a261-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "cinder-quobyte-d461f085-4520-4d9f-81fb-88b742a2a261" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-d461f085-4520-4d9f-81fb-88b742a2a261" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c8fd27-e51c-494a-a1e1-daa6bde33af1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:29 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 Apr 17 16:28:29 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:29 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc" returned: 0 in 0.535s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.remotefs [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7556fcf4-96cb-4530-b45a-76d19e49a3e8]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:29 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:30 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 Apr 17 16:28:30 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:30 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261" returned: 0 in 0.587s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:30 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261 Apr 17 16:28:30 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:30 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" returned: 0 in 0.540s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:30 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc Apr 17 16:28:30 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:30 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-d461f085-4520-4d9f-81fb-88b742a2a261" returned: 0 in 0.487s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-quobyte-d461f085-4520-4d9f-81fb-88b742a2a261" released by "delete_volume" :: held 1.099s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=209,cinder:UPDATE=271,cinder:INSERT=67,cinder:DELETE=24 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:UPDATE=277,cinder:SELECT=185,cinder:INSERT=62,cinder:DELETE=27 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Created reservations ['561a18a7-e3c5-4a78-8991-81cf720e8c01', '9730bea2-4c13-4b76-8f48-0fcc3eb93a83', '0edd289a-b339-4c9f-a113-95da7d44442d', 'cf1852d9-bdf8-41d3-bb3c-f446cb1fc8d2'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:30 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:30 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:30 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:31 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc" returned: 0 in 0.495s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:31 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc Apr 17 16:28:31 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:31 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.442s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Deleted volume successfully. Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-505b4cd5-5546-4020-9087-162c5ff52871 tempest-VolumeDependencyTests-963862766 None] Lock "cinder-d461f085-4520-4d9f-81fb-88b742a2a261-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:31 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10.26ff329c-5898-4fdc-bff8-340e082017dc" returned: 0 in 0.425s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-26ff329c-5898-4fdc-bff8-340e082017dc" released by "_delete_snapshot" :: held 2.063s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" released by "delete_snapshot" :: held 2.074s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Created reservations ['e69c4f9a-37c7-44bf-bca1-7bcc1403edc4', '1caad18f-c0c8-4ae5-8817-6b3fc362e7c0', '39cf7700-223f-49c5-84f2-5b38374e9c44', 'dd89b7ac-ca86-4d21-99a9-338d7aca0445'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:31 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Delete snapshot completed successfully. Apr 17 16:28:31 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-da168ab4-ebed-4831-b4da-fcffa4551a15 tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-26ff329c-5898-4fdc-bff8-340e082017dc-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "cinder-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "cinder-quobyte-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:32 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:32 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd1363c-1c74-4223-8996-108da41db072]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:32 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:32 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 Apr 17 16:28:32 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:33 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" returned: 0 in 0.472s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:33 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10 Apr 17 16:28:33 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:33 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" returned: 0 in 0.429s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10" released by "delete_volume" :: held 0.930s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Created reservations ['55802714-310c-4d09-a31f-547281de463d', '2e844d8b-bca1-420f-a2b0-ae3e4ffbd118', 'a6b94f27-fbff-4c4a-81d5-7b6eb1b9af8b', 'c200c12c-957a-49d6-a598-11095528b94d'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:33 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:33 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "cinder-6ca150ee-bb51-4227-b6e1-88d1bf708b95-delete_volume" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-6ca150ee-bb51-4227-b6e1-88d1bf708b95-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_service.periodic_task [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82061) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:33 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:33 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "cinder-quobyte-6ca150ee-bb51-4227-b6e1-88d1bf708b95" by "delete_volume" {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-6ca150ee-bb51-4227-b6e1-88d1bf708b95" acquired by "delete_volume" :: waited 0.008s {{(pid=82061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e161d5-2705-4b43-9ab4-ba793b3455e1]: (4, 'qcow2') {{(pid=82925) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:28:33 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:33 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 Apr 17 16:28:33 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:34 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.449s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:34 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Deleted volume successfully. Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-d9264275-a8ad-4fb4-8320-8f0ab567373a tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-6d3c4db3-fa1c-446f-b6ff-98dac6e90e10-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:34 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-b39671a1-3661-4071-98ad-370aa740583c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.448s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-b39671a1-3661-4071-98ad-370aa740583c None None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:34 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95" returned: 0 in 0.482s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:34 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95 Apr 17 16:28:34 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:34 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34/volume-6ca150ee-bb51-4227-b6e1-88d1bf708b95" returned: 0 in 0.409s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-quobyte-6ca150ee-bb51-4227-b6e1-88d1bf708b95" released by "delete_volume" :: held 0.912s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG cinder.quota [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Created reservations ['4d1364e5-41e1-491a-8847-bf3cde31cb0b', '99262f66-6023-4267-adb4-cfa9c4ca269b', '11fd3b6c-2c65-440b-8a14-e50b67f6605a', 'c4417b42-824e-49b3-8f65-f8ecdc6f8209'] {{(pid=82061) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4': None} {{(pid=82061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG cinder.volume.drivers.quobyte [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a794c3e2-b9d9-45f3-8437-693955670aa4'] {{(pid=82061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.lockutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82061) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:28:34 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:28:34 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34 Apr 17 16:28:34 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:28:35 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 17 16:28:35 devstack cinder-volume[82061]: DEBUG oslo_concurrency.processutils [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c57fcf2fbbf23ddd2390d0d1626eed34" returned: 0 in 0.483s {{(pid=82061) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:28:35 devstack cinder-volume[82061]: DEBUG cinder.manager [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Notifying Schedulers of capabilities ... {{(pid=82061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:28:35 devstack cinder-volume[82061]: INFO cinder.volume.manager [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Deleted volume successfully. Apr 17 16:28:35 devstack cinder-volume[82061]: DEBUG cinder.coordination [None req-e967baac-8f2b-4b99-9ca5-4d3d64df451b tempest-CinderUnicodeTest-1066328607 None] Lock "cinder-6ca150ee-bb51-4227-b6e1-88d1bf708b95-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82061) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:28:44 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=20,cinder:INSERT=10,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:28:45 devstack cinder-volume[82061]: DEBUG dbcounter [-] [82061] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=82061) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}